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FOREWORD 



The health maintenance orgTOization concept , emerging from the successful 
experiences of selected prepaid group practice organizations and medical foOTida^ 
tions in the United States ^ was defined by Paul Ellwood in the early 1970*s. 
He characterized HMOs as those organizations which provide co^rehensive health 
services to voluntarily enrolled consuMrs, on the basis of fixed price or 
capitation - contracts. The concept^ of course , was not new. Unique , however j 
was the accelerated interest in this organizational structure for reconfiguration 
of health services of the United States in general. Various elements of the HMO 
model, the potential for cost containment ^ the practical utiliEation of epidemi- 
ologic concepts ahd preventive health measures s the possibilities for experi^ 
mentation with varied organizational assignments of health professionals j the 
philosophy of responsibility for the hea lth of a defined population prese nted 
features of interest to the Administrations the Congress ^ and the academic 
medical community* Newly developed health care programs j assisted by Federal 
financing and organized in a fashion encompassing the concepts described 
above, became attractive models not only for the education of undergraduate 
and graduate medical students and students of other health professions , but 
also as organizational concepts through which the academic medical center might 
discharge some or all of its health care service obligations to the surrounding 
community. Furthermore, as a means for meeting the need for additional exper- 
iences in ambulatory care in order to accommodate eVer larger class sizes 
correlated with increased emphasis on primary care educationj academic medical 
center^health inalntenance organization affiliations appeared attractive. 
By 1973, 15 percent of the academic medical centers had developed formal 
affiliations with HMOs, and an additional 68 percent had either definite plans 
to establish such or were contemplating this action. 

In 1973 J the Association of Merican Medical Colleges ^ under contract 
with, the HMO Office, Health Services Administration^ Department of Healthy 
Education and Welfare (Contract No. HSM 110-72^393), developed a project 
which described and analyzed various prototype arrangements, A summary of. 
that work was completed in August 1974. It was soon realised that, although 
the development of a mutually agreeable affiliation was in itself a complex 
matter, the Introduction of even minimal numbers of students into health care 
programs whose survival was dependent upon the very critical factors of effi- 
ciency of operations and consumer acceptance, presented problems of even greater 
complexity* Paradoxically, the growth of the WiO concept nationally would be 
dependent on the number of young physicians experienced in this concept. Con^ 
sequently, a project related to curriculum development for the education of 
physicians in tMOs was considered to be a desirable corollary effort. The 
current project, supported by the Bureau of Health Manpower, Department of 
Health, Education and Welfare, addresses the issues of curriculum development, 
implementation, and evaluation and the methodologies for identifying educa- 
tional costs. This report details the results of a collaborative effort of 
six academic medical centers and the affiliated health maintenance organtizatlons, 
and it makes recommendations for future programatic development* 
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At present, it is difficult to predict the rate of ffliO growth in the 
United States* A new AAMC study currently underway indicates that in 19765 
17% of the acrdemic medical centers report formal affiliation with ffilOs, 
and only 12% report plans to develop such. Many events of the past four 
years have had a retarding effect upon such growth nationally* In view of 
current conditions, early predictions of having the WLO option available 
to 90% of the U*S* population by 1980 appear naive ^ overly optimistic, and 
unrealistic. Furthermore, because of continued economic uncertainties, it 
is difficult to predict the immediate effect of the recent HMO Legislative 
Amendments . 

The reader should be aware, however, that the major issues addressed in 
this project - the development, ImplOTentation, and evaluation of curriculum, 
and the development of methodologies for calculating educational costs are 
themselves generic Issues not necessarily confined to the WdO concept. These 
are issues of obvious concern to those charged with the planning of primary 
care education in general, and for those chaged with arranging ambulatory care 
experiences in particular. As such, it is to be hoped that this report will 
provide useful information to those charged with curriculum development * to 
faculty preceptors, and to health systems administrators Involved with teaching 
programs ~ 



James I* Hudson, M.D, 
Project Director 
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PREFACE 



This report Is an effort to sumraarlze and synthasize 
the work of six academic medical centers and affiliated health 
maintenance organizations that participated in the project for the 
development and implementation of curricula for physician training 
in HMOs, The selected works of the participating institutions 5 
presented as resource papars following Chapter 8, constitute the 
bulk of the report. They are organized along the focal issues of 
the project — (1) curriculum developMnt process^ (2) curriculum 
content, (3) instructional methods^ (4) program evaluation, and 
(5) educational costs. The first chapter describes the purposes 
of the project and its methodology and the six subsequent chapters 
sunroarize the institutions- acco^lishments . ^le final chapter 
is an effort to synthesize these achievements, and present our 
findings, conclusions and recommendations. 

This project is indebted to the members of the project advisory 
cormnittee, Drs* Samuel J, Boschj Joel J. Alpert, Jack D. ^fyers, 
Mitchell T, Rabkin, John P. Utz and Eugene Vayda^ for their dedica- 
tion, advice and guidance in designing and directing the project; 
to the special consultants, Drs, Christine E* Bishop, Arthur S, Elste 
and Edwin B, Hutchina, for producing excellent results imder trying 
circumstances; and to the Project Directors for the institutional 
projects and their staffs, without whose toilj dedication and 
cooperation this project would not have succeeded. 
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Chapter 1 

OBJECTIVES MD METHODS OF THE PROJECT 



This project was conceived in the early 1970' s when HMOs first gained 
national prominence and active support from the federal goverraient as a 
new and viable alternative to the current health care system. Predictions 
were made at the time that, "The current S--^? million WLO enrollees could 
increase to approximately 40 million by 1980. , . Physician requirements 
would increase from 7*000 full-ttoe equivalents in 1973 to about 40^000 by 
1980. This figure represents about 10% of the expected number of physi= 
clans practicing in 1980. , [1]. Although the need for phyaician man^ 
power in WOs today is not as great as predicted (less than 6 million 
people were enrolled In HMOs in 1975 [2]), prtaary care education in the 
WO is no less Important today than it was several years ago. 

The increasing pressure in recent years on medical schools to produce 
more primary care physicians has resulted in efforts to develop new and 
appropriate sites for primary care training at both the graduate and 
undergraduate levels of medical education. An organized system of care 
such as an WIO has the advantage of providing an alternative approach to 
health care over the traditional hospital outpatient department or the 
office practice. Moreover, although the nationwide shortage of primary 
care physicians willing to practice in the WO is not as great as once pre-* 
dieted, the geographic maldistribution of primary care physicians has 
resulted in acute regional shortages ^ especially in rural areas. In factj 
a recent report cites the inability to obtain physicians as a major cause 
for .recent failures of HHlOs [3] • 
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The overall goals of the project, then, werei 

(a) To encourage the establislnnent of IMOs by developing training programs 
that would help in increasing the "supply of appropriately trained , 
oriented, and motivated phyBicians to allow major growth and expansion 
of the mo concept in the U.S." [4]| and 

(b) To develop "educational programs with major emphaais on primary and 
comprehensive care to train physicians to function effectively in the 
roiO health care team setting" [4], 

The Association of ^erican Medical Colleges (A^C) entered into contract 
with the Bureau of Health Resources Development (presently Bureau of Health 
Manpower), Health Resources Administrations Department of Health, Education 
and Welfare in May 1974. The contract called for the AMQ to solicit 
proposals and select* with the assistance and guidance of a project 
advisory committees six medical schools sponsoring or affiliated with WiOs 
and willing to develop KMO-based educational programs for medical students 
and/or residents. By September 1974 s six medical schools and their affil- 
iated H^Os had been selected for participation* 

In June 1974 the APMC Invited medical schools to submit^ on a competitive 
basis^ proposals outlining their interest and qualif icatlona* A copy of the ^ 
letter of invitation is presented as Appendix 1 following this chapter* To 
qualify, a medical school had to have an affiliation with a local WO and a 
history of activities in and understanding of prlinary care issues, A letter 
of interest and support from the WIO was also required. Up to "40,000 for 
program development and staffing was offered to each institution selected 
for participation. Eleven medical achools submitted proposals and, of these. 
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the following schools and WOb were aelectedl 

1. Georgetown University and Georgetown UnlverBity Coimr.unity Health Plan 
. (GUCHP), Washington, D,C. 

2. University of Rochester and Genesee Valley Group Health Association 
(OVGHA), Rochester, New York 

3* University of Pennsylvania and Penn Urban Health Maintenance Program 

(Penn Urb), Philadelphia * Pennsylvania 
4 8 University of Washington and Group Health Cooperative of Paget Sound , 

Seattle, Washington 
5. Brown University and Rhode Island Group Health Aseociatlon (RIGI^) ^ 

Providence, Rhode Island 
6* Harvard University and Harvard Community Health Plan - Cambridge Center 

(HCHP-CC), Cambridge^ Massachusetts 
The most important selection criteria were the clarity and specificity of 
the curriculum objectives, the appropriateness of the curriculum development 
process, and the feasibility of the proposed study. 

In November 1974, the AAMC subcontracted with each participating medlCo 
school to develop, during the calendar year of 1975, the curriculum speci^ 
fled in its proposal, to develop appropriate evaluation mechanisms and to 
estimate the cost of education in the WiO. For monitoring purposes, the 
institutions were required to submit a work plan, quarterly progress report 
and a final report by December 1975. The major milestones and activities of 
the project are presented on the following page. 
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Project to Develop Curriculum 
for 

Physician Training in WLOb 



TIMTABLE 



Milastones 



Data 



Project begins . . , • , , , 

First meeting of project advisory committee (PAC) 

Letter of invitation mailed to medical schools , . . , 

bubmisaion of Proposals 

Second PAC meeting; selection of participating Institutions 
Orientation sessions Washington^ D,C, , 
Curriculum development activities begin 

Second nteeting of project participants^ Rochester^ N*Y* * 

Site visits 

Third PAC meeting * . * . . 

Third meeting of project participants, Cambridge ^ Mass, 
Meeting on curriculum evaluation . * - . , . * 

Presentation of symposium at AAMC Annual Meeting 
Termination of curriculum development activities * 
Submission of institutional reports to AAMC , , * * , 
Submission of A^C report to DHEW and project termination 
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May 1974 

June 

June 

August 

September 

November 

January ^ 

March 

April-- Jul J 

June 

September 
November 
Novan^er 
Da center 
February 1 
July 1976 
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The institutions accomplished much more than required. The Bureau of 
Health Manpower (BHM) required the development but not taplementation of 
curricula, Nevartlieless, virtually all groups not only constructed IMO- 
baaed curricula but they field- tee ted and Implemented them during the course 
of the project. In addition, most of the groAips designed evaluation tech- 
niques for aaaessing the effectiveness of the educational progrrais or 
developed cost methodologies for esttoating the cost of education in the 
HMO J neither of which was required under the terms of the contract. 
Two institutions, the Universities of Rochester and Washingtons worked on 
both evaluation and costs. 

The projects benefited from three conferences 'that were held during 
thu course the contract. The initial conference, held at the AMQ head- 
quarters in Washington^ D*C. in NovMber 1974^ was an orientation sesaion 
for participants. No further meetings were planned but at the orientation 
session participants expressed a strong desire to meet again soon to share 
information and ideas amongst each other. With the approval of the BIM 
Project Office, the AAMC arranged two additional conferences. The first of 
these two-day conferences was hosted by the Rochester group in March 1975 
and the second was hosted by the Harvard group the following Septanber. 

Both of these conferences focused on three major lssues~curriculum 
content and design * program evaluation^ and education coste—and provided 
forums for sharing skills and new ideas. The conference agendas are 
preaented as Appendix 2 at the conclusion of this chapter. 

As the project progressed, it becaTO evident that special assistmee 
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waa required on three issues—inatructional methods^ avaluation and eosts, 
Dr, Arthur S. Elsteln, a medical education specialiit from Michigan State 
University^ was anployed by the AAMC to provide assistance in inatructional 
methods. He presented hie ideas at the Rochester conference and later 
prepared a paper on the subject , which is presented as Resource Paper No. 7 , 

With regards to evaluation , a consensus was reached at the Cambridge 
conference that there was a need to coordinate efforts in currlculius evalua- 
tion and to produce, if possible, a core evaluation design based on shared 
educational objectives in the WiO setting. Dr. Edwin Hut chins j consultant 
to Penn Urb and a nationally recognlEed authority in medical education and 
evaluation^ was chosen to head this effort* A small meeting of participants 
was held in November 1975 to consider the implications of long-term evalua-^ 
tion and to Identify evaluation methods or materials suitable for sharing. 
The result was the development of tentative evaluation Instruments pre- 
sented in Resource Paper Ng^. _9 t 

To provide assistance in the development of a cost methodology, the 
Amc employed* in September 1975, Dr. Oiriatine E. Bishop, a health economist 
from the Boston University School of Management. Dr. Bishop attended the 
Cambridge conference but there was not enough time for her to assist the 
participating Institutions who were developing cost data. Instead, 
Dr. Bishop was asked to develop the conceptual framework for measuring the 
costs of education in the HMO. The results are presented as Resource Paper 
No. 14 . 

Monitoring was accomplished through periodic progress reports and site 
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visits. Each participating institution submitted a work plan and two 
prograss reports and was site visited once by the AAMC staff and members 
of the project advisory coTmnittee. 

The project received considerable publicity at the MMC Mnual Meeting 
in November 1975 -K^ere project participants organized and presented a sympo- 
sium entitled Teaching Primary Care In the HMOi Design. Evaluation and 
Costs* The papers presented at the eyroposlum have been for the most part 
rewritten and are included raong the resource papers in this report* 
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AppendlK 1 



ASSOCIATION OF AMERICAN MEDICAL COLLEGES 



MEMORANDUM #74-18 June 24, 1974 



TO: Council of Deans 

Council of Teaching Hospitals 

FROM: John A. D, Cooper, M.D., Prtsident 

SUBJECT: Contract for the Development of Curriculum for Physician Training 1n HMO 



The Association of American Medical Colleges has been awarded a 
contract by the Special Program Staff of the Bureau of Health Resources 
Development, Health Resources Administration, DHEW to support the development 
of curriculum for physician training In academic medical center related HMOs* 
This 21 -month project Is complementary to a previous AAMC project for the 
development of prototype HMOs which will terminate on June 30, 1974, These 
endeavors reflect the Association's ongoing effort to promote medical school 
and teaching hospital Involvement in improving the ambulatory health care 
system of the nation* 

Whereas the prototype HMO project focused on the unique aspects 
of planning and developing an academic medical center related HMO, this BHRD 
contract will allow the AAMC to stimulate the planning and development of 
curriculum for training physicians In the HMO setting. If HMOs are to expand 
and become a viable alternative system of health care, appropriately trained 
manpower must be available* Without the necessary personnels even existing 
HMOs may be unable to expand their enrollment to meet demand. 

Within the framework of this project, the Association will work 
closely with six (6) selected institutions by providing technical assistance, 
centralized coordination and limited support funds to develop educational 
programs (with major emphasis on primary, continuing, comprehensive care) which 
would train physicians to function effectively in HMOs* The principal objective 
of the BHRD contract Is to assist in developing curriculum for medical students 
or house staff that are based upon and oriented towards medical practice 
requirements of HMOs* As stated In the BHRD contract, the primary requirement 
for participating institutions should be the development of a plan Including 
a curriculum for the establishment of an education-training program for 
medical students or Interns and residents which utilizes as a primary learning 
tool an HMO which the university health science center sponsors or with which 
1t has formal affiliation. This effort will hopefully establish a mutually 
beneficial relationship betwr ^n the HMO and the medical school/teaching hospital 
for purposes of clinical education es well as patient care. 

If you would like to have your institution considered for participation 
in this project, please submit a proposal of no more than twenty pages which 
should Include but not be limited to: 
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a. Definition of primary care. 

b* Description of institutional activities in primary care 
education, 

c. Educational objectives of the proposed curriculum ^ taking 
Into consideration the desired end results In terms of 
students' sklllSt attitudes and knowledge* Basic elements 
of such a curriculum should include: patients, students, 
faculty and setting, 

d* Description of the process for developing an appropriate 
curriculum for training medical students or house staff in 
an HMO setting. 

e. Realistic plans for Implementing the curriculum, 

f* A plan to develop criteria for selection of medicail students 
and house staff who elect to train In the HMO setting* 

g. Evidence of a relationship between your institution and an 
operational or nearly operational l#10 (Including a description 
of the HMO). In case of affiliation with an HMO ^ please Include 
a latter of support from the Executive Director and the Medical 
Director of the HMO, 



h* Institutional resources and capabilities available for developing 
such a curriculum, 

1* A budget. 

The AAMC has established a project advisory committee that will 
select the six participating institutions. It Is anticipated that participating 
institutions would receive up to $40,000 to develop its proposed curriculum 
during the period January 1 through December 31 t 1975. The BHRD stipulates 
that institutions must meet the following basic requirements in order to be 
eligible for consideration. 

1. Each participating institution shall Include a university 
sponsored or affiliated HMO. 

2. Preference in consideration will be given to programs whose 
HMO service component is operational or nearly operational, 

3. The curriculum to be developed must be directed primarily at 
medical students or house staff. 

4. Proposals should include the development of a process for i 
relating medical student and house staff HMO education and ' 
training experiences to career selection. 
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Following the selection of the six participating institutions, negotiations 
will be undertaken on the amount and type of support that can be provided ^ 
under the contract. 

If your institution wishes to participate 1n this project, you should 
send your proposal to: • 

James I. Hudson, M.D. 
Director, Department of Health Services 
Association of American Medical Colleges 
One Dupont Circle, N.W., Suite 200 
Washington, D.C. 20036 

Neither the AAMC nor the BHRD Is under any obligation to award a contract on 
the basis of any proposal submlssloji or othftrwlse pay the costs Incidental to 
the preparation of proposals. 

As a condition of participation, institutions may not Include more 
than B% of total direct costs as "overhead" or Indirect costs in their budgets 
We are also asking that you identify, by name. In your proposal the following 
individuals who will be relating to your HMO edycatlonal development program 
(If selected for participation): 

,„ - - 1. Project Director 

2. Fiscal officer for the project 

3. Institutional contracting officer 

Proposals should be postmarked by Friday. August 2. 1974 . 

If you have any questions, please do not hesitate to call Dr. Hudson 
(202/466-5131) or Ms. Lily 0. Engstrom (202/466-5118). 
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THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 
iogei/teA w4Xh. the. 
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DEVELOP CURRICULUM FOR PHYSICIAN TRAINING IN HMOS 



In 
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■ 

ThuJUcky and VfUdaij, hkuich ?3 and ?4, 1975 
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AGENDA Appendix 2 (continued) 

Thimdatj, UoAch 13, Tht AndeM>on Room, mdlatd. EducxUion BuMcUng (S-W-iag) 

^ 10:00 AM WELCOMING REMARKS Dean Orbison; Dr. Hudso 

10:10 AM OVERVIEW - Vir. Infeld 

10:20 AM PRESENTATION OF PROJECT WORK PLANS , _ Project 01 rectors 

• UnUXed to 15 mLnuLteA peA pKUtntatLon. • A quutlon 
and an&weA peMod wUZ ioMou) mah pn.ue.ntaZlon 

12:30 PM Luncheon. Segued in pfUveutz worn one. flight afaoue 
AndeA&on Room 

1:30 PM EDUCATIONAL METHODS AND EVALUATION IN THE HMO Riactor Panel 

PandLUtAt Vfi. knthuji Ei^teM, Hodviaton. 
VfL, PomZ GMveA 
Wi, John Simon 

3:00 PM IMPACT OF PROPOSED MANPOWER LEGISLATION ON HMO 

TEACHING PROGRAMS Mr. Bowsher 

QsiUtlon and kn&weJL ?e/uLod 

4:00 PM Coffee Break 

4:15 PM A MODEL FOR PRIMARY CARE RESIDENCY TRAINING Dr. Boufford 

Que&i-ton and kn&MeA VeAiad 

I 5:15 PM The Happy Hour. CocMaJM the. Cha.nc.2Zlon.' a VivuMg Room, 
UnAjueMity facattij CZjxh, VoagloM BLiMding, RiveA CojnpM 



6:30 - 8:00 PM Dinner Uamt pZacz afaoue) 



rjuday, MoAch 14, Thz Gewedee VaJUty G-toup HejnuUh AiAocUatlon (Gt 
Jo6&ph C. lilUMon HeAUh CznZzA, 800 CoAteA StAtU, tochutzx, Hm Vo/ik 

9:00 AM GVGHA'S TEACHING PROGRAMS FOR HOUSE STAFF AND NURSE 

CLINICIANS: OVERVIEW AND ANALYSIS Dr." Gardner 

QnzMtion and AtUueA PthMod 

10:15 AM HMO TEACHING PROGRAMS: COST FINDING METHODS Dr. Gllsoni 

Quwiion and An4weA VvUod Di^- Lawrence 

11:30 AM NEXT CONFERENCE . . Participants 

ContAaat iandA aAt avaJMblt to hold om addJMonaZ 
meet4wg . ShouZd anothzA mee-ttng fae heZd? WheAe., 
(joKm, and ion. vihat puApoiU? 

12:00 Noon Guided Tour of the Wilson Center 

12:30 PM mOUWmNT 
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Appendix 2 (continued) 

SECOND CONFERENCE 

Project to Develop Curriculum for Physician Training In HMOs 

Harvard Faculty Club Building 
Harvard 4Jn1 vers 1ty Campus^ 20 Quincy Street 
Cambridge, Massachusetts 

September 29-30, 1975 



Monday J Saptember 89 

8:30 A.M. Introductions - J, Budsm^ M. Infeld 

Workshop I. CURRICULUM CONTENT AND DESIGN 

Moderator' S, Bosdh 

Facilitators: J, Simons H, Gardner 

Noon Siesta 

2:30- 5:30P.M. Workshop II. COST METHODOLOGIES 



Undergraduate Level: G, Pawlaon 

Graduate Level: E, Lmrenae^ R, Watkins 



Tuesday J Seytember SO 

8:30 A.M. Workshop 111, APPROACHES TO CURRICULUM EVALUATION 

Facilitators: P. OroVeVi M, Eavitah 

11:30 A.M. FINAL REPORT - Objectives, Content, Format M. Infeld 

1:00 P.M. Adjournment 
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Chapter 2 
GEORGETOWN UNIVERSITY 
and 

GEORGETOWN UNlVERSI'n COMMUNITY IffiALTH PLAN (GUCHP) 

The GeorgftoFn group's major achievOTenti werei (1) the development 
of a unique curriculum planning process; (2) the preparation of an WLO 
manuals (3) designing and implementing a preceptor training programi and 
(4) preparing a manual for the preceptor training program. Items 2 and 4 
are presented under aeparate covers as Resource Papers 2 and 7 , The study 
was conducted by the medical school's Department of Conmunity Jtedtelne and 
Intemational Health with the collaboration of the GUCIff medical staff and 
three sophomore medical students* 

BACKGROUND 

Georgetown University's medical school is part of a larger Health 
Sciences Center which includes a teaching hospital, a dental school, and a 
school of nursing* In 1971 the medical school implemented a major curricu- 
lum revision and thereafter rapidly increased the si^e of the entering 
class to its current level of 205 students. The resulting stress placed 
upon teaching resources^ particularly in ambulatory care, motivated the 
medical school to establish a health maintenance organization, the George- 
town University Community Health Plan (GUCHP). In fact, (GUCHP, which was 
initiated by the Department of Connnunity Medicine and International Health 
(DCMIH), was authorized by the medical school with the understanding that 
the WIQ would provide a resource for primary care education and research. 
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GUCHP is a pre-paid group practice type HMO whleh opened for aervlces 
in November 1972, Although it li legally an independent corporate entity ^ 
most of the members of the board of directors are appointed by the Univer- 
sity President, and the Chancellor of the Medical Center serves as Chairman 
of the Board, while the Dean serves as Vice-^Chairman* GUCHP presently serves 
over 20,000 "pre-paid" enrollees and an additional fi,000 "fee-^for-^ 
service" patients in three primary care facllitiee in the Washington metro-^ 
polltan area. One center is located in Reston^ Virginia and serves a 
predominantly white upper middle class population ; the second center, 
located in Edgewood Terrace Housing CompleK in Northeast Washington^ serves 
a predominantly black, low and moderate Income populatloni and the third 
center in Kensington, ttoryland, serves a relatlvsly stable rsUburban^middle 
class coranunlty in the greater Washington area* Each center utilizes a 
local community hospital for general inpatient care and Georgetown Univer- 
sity Hospital for tertiary care, 

GUCHP was heavily involved in education even prior to the initiation 
of this project* Educational experiences at GUCOT Included a 6-month field 
training for two physician assistant students from Northeastern University 
(both were later hired by GUCiff)| a physician assistant training program 
for pre-medical and first year medical students | a siK-week elective clerk-- 
ship in primary care| and rotation of senior psychiatric residents under the 
supervision of the faculty of the Department of Psychiatry, However, these 
educational experiences were offered imrelated to each other, without an overai; 
curriculmn plan or mechanisms for evaluation. Hence, Georgetown's initial 
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objectiva was not so much the conetruetion of a eurriculump but rather the 

development of a rational curriculum planning proceaa ^ as It Indicated in 

its final report to the AAMC: 

"If you think you're confused j consider poor Columbus. 
He didn't know where he was going! When he got there, 
he didn't know where he was. And when he got back, 
he didn't know where he'd been*" 

Anonymous 

In many ways, the task of curriculian building for physician training 
in health maintenance organisations is similar to the eKperlence of 
Columbus* There are groups of doubters, there is a dearth of funds, 
and the waters are uncharted* A major outcome of our project has 
been a mapping of where we are going. As a result, when we get 
there we will know where we are and with the use of evaluation, 
know where we have been. In essence, the major accomplishment of 
our project has been to establish a curriculum planning process, 
rather than a finalized, pQllshed, discrete set of couraea. 

THE CURRICULUM PLANNING PROCESS 

The curriculum planning process developed by the Georgetown group is 
based on an analysis of the skills, kjiowledge and attitudes required by 
competent practitioners in the WLO setting* Since a comprehensive, func- 
tional analysis of physician performance In IMOs was beyond the scope of 
this project, an abbreviated approach, represented in the echematic dia-- 
gram below, was developed. The ultimate result of this approach is a list, 
or "mastery description," of professional responsibilities which the com^ 
petent practitioner has "mastered," or should have mastered. These are 
then converted to educational objectives which the student must master or 
gain competence in. The process involves the five steps defined in the 
schematic diagram. A description of their implementation at Georgetown is 
presented below. 
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SCHEMATIC REPRESENTATION OF DYMAMIC CURRICULUM PLANNING PROCESS 



1 




MASTERY 
DESCRIFTION 




'STAFF TRAINING ^ ^ 
-STUDENT HMO CURRICULUM ^ 



_1 -^RELEVANT COf^ONENTS OF G,U. CURRICULUI4, 
^ ^RELEVANT CO.WOmNTS OF OmER SCHOOLS' ^ 
CURRICULA 



DOUBLE ARROWS: Indicates a one=to-"One relaclonihip " 

MASTERY DESCRIPTION: a Use of profeisional tasks or responsibilities 

that a competent primary care practitioner must 
master 

STAFF TRAINING: the Identification of such tasks or responsibilities 

currently missing from our HMO primary care practitioners 
and training of staff In these areas 

HMO CURRICULUM: the educational objectives and Instructional activities 
derived from the mastery description as modified by 

O.U, CURRICULUM: what is relevant and already learned somevhare else in 

the Georgetom curriculum complemenced with 

OTHER CURRICULA: successful and relevant educational opportunities 

implemented by other schools 

Sourcei The Georgetown University final reporti December 1975. 



a. Mastery Description - The object is to obtain a list of professional 
taeks or responsibilitlea unique to prtoary care practice in the IMO, by 
involving in the process all parties concerned i the practitioners (physi- 
cians and nurses), the recipients (patients), and the students (medical and 
nursing fltudtnte) of primary care* 



i 



Three medical and three nursing students were hired for the sunmer to 



conduct interviews with GUCHP physicians, nursee and patients* A team 
of one medical and one nursing student was assigned to each of the three 

:GUCHP centers. Af tet;^ aa Intensive literature search, ^ students p^^ared 

an initial list of physicim and nurse professional competencies md 
then interviewed physicians, nurses and patients , using the queationnalree 
presented at the conclusion of this chapter as Appendices 3 and 4 . Initial 
analysis of the data Indicated a need not only for a student guide and a 
preceptor training progrm. but also for teaching experiences In telephone 
medicine; developing a good' "chalrside" manner | and a prtaary care team 
clerkship. Further work on the mastery list has been temporarily dis- 
continued, but the study staff hopes to reside their efforts as the value 
of such a process gains added support within the medical achpol* 

b. Staff Training - The physician interviews helped In identifying a 
need for a training program to develop the teaching skills of the clinical 
staff. Since the development of such a program was not within the scope of 
the original study design, Georgetown University requested and obtained 
AAMC and DREW approval to axtend the project for ste months *:o June 1976* 
On the basis of the assumptions presented belowj Georgetown University 
implemented a six-hour Preceptor Preparation Course for ^2 GUCffi staff 
physicians. The materials prepared for the course have been organised as a 
manual entitled A Role Guide and Resource Book for Cllnica Preceptors , and 
is presented as Resource Paper 7 under separate cover* 



The nursing component was funded by another agency and concerned 
multi-disciplinary training of medical and nursing students in primary care 
teams* 
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ASSUMPTIONS OF PRECEPTOR PREPARATION PROGRAM 

Q IMO physicians are usually recruited and hired for their clinical 
competencies, not their teaching abilities. 

° Teaching skills are not necessarily innate, but rather can Be 
learned , 

0 IMO physicians who act as instructors must be otlentad to the 
overall goals and approach of the educational program. 

•> Approaches for student learning in the ^0 (based on the require- 
ment of provider productivity and consumer volca In management) 
will require methods of instruction unfamiliar to the traditionally 
trained physician. 

" There arc a variety of teaching roles and raaponslbllities IMO 
preceptors can and must fulfill if a well-plaimed curriculum is to 
be successfully Implemented. / 

Sources Georgetown University final report, Decwiber 1975. 

c. Curriculum Development - The first step In curriculum development was 
the offering of an experimental course entitled A Practica l Introduction to 
IMOs. Designed for testing teaching materials, Instructional methods and 
preceptor-student interrelationships, the course involved didactic sessions 
guest speakers, field visits to local ffllOs, and research projects under the 
supervision of GUCHP staff. A major result of the course was the develop- 
ment of A Medical Student's Guide to Health Maintenance Org anizations, pre- 
sented under separate cover as Resource Paper 2 . The 50-paga guide, 
designed by medical students for medical students, describes the nature of 
iwOs and presents the major' Issues affecting IWOs today. Of particular 
value are the self-assessment and group dlscuaslon questions included in 
each chapter. The guide is already being used by several institutions 
including a medical society group. 
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d. Relevant Components of Medical School Curriculum - The four-year G.U. 
medical currlcultro was eKamined for primary care=ambulatory care experiencaa 
presMtly of fered so as t« avoid dup - 

e. Relevant Curricula from Other Medical Schools This involved a 
review of published literature from other schools and continual communica- 
tion with the other institutions participating in this project. 
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STAFF INTERVIEW FORM 



AppendlK 3 

Center 



Education. and Experience Back^rQUnd 

1. What field was your training in? 

^(M.B. ) r Residency Field: ' • - ' • - ' ' ' 

(R.N.): A,D. Diploma B.S.N. 

M,S. _____ 
Nurse Practitioner Field 

M.D.: Are you Board eligible? Yes No 

Are you Board certified? Yes No ^ 

R.N.: Are you certified as a nurse practitioner? Yes No _ 

2. What kind of patient care practice have you been in since the end of 
your formal training? 

Solo Hospital Military Group ^ ^ 

HMO _^ Cllncial or Neighborhood Health Center 

For how long? 
Type of patients: 

Adult Adolescent Geriatric Child 

Family Other 

Relationship with GUCHP 

3. How long have you worked for GUCHP? ___________ 

4. What made you decide to come to work for GUCHP? 



5. How do you define primary care? 

6. ^ (a) What do you find satisfying in working 1n primary care? 

(b) What do you find unsatisfying in working in primary care? 

7. Could you compare working in this HMO setting with your previous health 
care settings in relation to: 

(a) how Is primary care different? 

(b) how is the HMO setting different? 



Appendix 3 (continued) 

8. Do you see a difference in the health care needs of clients in tho HMO 
setting from those in your previous experience? 

Do you feel that enroll ees abuse the health care services because of 
the prepaid nature of the practice? 

9, What kinds of things do you do in the heaUh center? 

10. Are there any tasks you would like to be freed from doing in order to 
use your training more fully? 

11. Do you have professional skills you feel you should be using that you 
aren't employing? 

12. Do you use POMRs? Yes No 

If you're using some variation could you explain it and why you prefer 
It? 

Were you instructed In the use and preparation of GUCHP medical records? 

Yes No Where: . When: 

by Whom: . 
13* Do you feel you have enough time to spend with each client? 
Yes No 

How would you spend the extra time If it were available? 

14. Is there anything else that would facilitate your provision of services 
to your clients? 

15. How do you think patients feel about the care they get here? 

16. Who 1s responsible for educating individual patients 1n coping with 
their health problems? Why? 

17. How do you handle follow-up? 

18* What preventive care do you provide? 

19. Do you think the quality of care is affected if a client sees 
different team members each time? Yes No ^ If sOi how? 

20. What kinds of things have you encountered in primary care practice 
that your education didn't prepare you for? 

eg. Patient "management skills: 
Telephoning: 
Counseling: 
Physical Assessment: 
Supervisory skills: 
Relating to other professionals: 
Interviewing ambulatory patients: 
gj^Q Teaching students: 3i 



AppendiK 3 Ccontlnued) 

Role Perception 

21. How do you view your own role in this setting? 

22. What do you see as the nurse practitioner's/doctor's role on your team? 

23p 'What do you feel are the most Important factors which Influence your 
role relationship with the phys1c1an/nurse? 

24. How are the roles different from your previous experiences and 
relationships? 

25. Do you see an overlap between the nurse practitioner and M,D, 
rasponsiblHties? Yes No ^ If yess where do you see this? 

What is your opinion of it? 

26. Do you have any supervisory responsibilities? Yes No 
What are they? 

27. To whom are you responsible? 

28. Who is responsible for managing the center on a day--to-day basis? 

29. Who decides which patients are seen by you? 

30. Who determines the lengths of appts. and how many patients will be 
seen each day? 

31. How are you affected by these decisions? 

32. Do you have any professional relationships with the other GUCHP centers? 

Yes __ No ^ , ' 



If so, what? 

If no, is there a need for this? Why? 

33, How do yoUp as a provider^ perceive your relationship with the 
McArthur office? 
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Center 



Interviewer 



Introduction 
Explanation 



-MS- 



PATIENT INTERVIEM FORM 

Day ______ 

Time 



Appendix 4 



Patien t Sex^ 
Adult Parent of ChiTd 

Adolescent 



PRE-VISIT INTERVIEW 



3. 

5, 
6, 



Is this your first visit to the Health Center? Yes No 

How long have you been coming to the Health Center? 
How many times have you visited before? 

If you feel comfortable in answerlngp what brought you to the Health 
Center today? 



Do you know who you're scheduled to see today? Yes 



No 



Is this the person you've seen on your past visits? Yes No 

Who do you regularly see? Doctor Nurse Other 

7, Do you like being able to see the same person? Yes No 

8^ What do you want to happen during your visit today? 

9* Do you have any questions on your mind you want to ask the doctor or 
nurse today? Yes No 



2. 
3. 

5. 



POST-VISIT INTERVIEW 



Was your visit with the doctor 



or nurse 



Was this the same person you've seen before? Yes 



No 



What things were satisfying about your visit with the doctor/nurse? 

What things were not satisfying about your visit with the doctor/nurse? 

Generally when you come does happen? 

Can you think of anything else the doctor/nurse could have done to 
improve your visit? 



6. Do you feel you had enough time with the doctor/nurse today? 



O „ 7. Did you get all, your questions answered? Yes 
ERJC Did you ask all your questions? Yes No ^ 



No 
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Chapter 3 

UNIVERSITY OF ROCHESTER SCHOOL OF MmiCINl MD DENTISTRY 

and 

THE ^EMESEE VALLEY GROUP HMLTH ASSOCIATION (GVGHA) . . 

Although the University of Rochester group dealt with each of the 
three major components of the project (curriculum contents evaluation and 
costs) ^ it devoted most of its energies to evaluation. Two paperSs one of 
^Ich has been published in the Journal of Medical Education , were prepared 
on the subject. The group designed , implemented and evaluated an IMO--based 
currlculT^ for flrst^year medical students. It is presently In the process 
of conducting similar efforts for a course for fourth-=year students. The 
project was conducted jointly by the medical school and IMO under the 
direction of the Associate Dean for Medical Iducatlon, 

BACKGROUND / ' 

In recent years the University of Rochester medical school has placed 
increasing emphasis on primary care in its curricula* An Mibulatory care 
eKperience, either at the University's Strong Memorial Hospital or in other 
extramural ambulatory care settings, is now required of all fourth-year 
students* The Division of Family Medicine now offers three electives for 
pre-clinical students and the Department of Preventive Medicine and Com- 
munity Health offers a wide-ranging first-year elective entitled Introduction 
to Preventive Medicine and Community Medicine ^ in which students are placed 
in community health facilities. One of these facilities is the Joseph 1. 
Wilson Center of The Genesee Valley Group Health Association (GVGHA) . 



GVGHA was one of the first successful IWOs sponsored by Blue Cross, 
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Located in an attractive 52, 000-square-f oot facility, it opened for servicaa 
in August 1973 and rapidly increased its enrollment to its present 20,300 
. members. An additlpnal. 2^000 persons are served on a f ee-for-seryice basl^^^ 
GVGHA has no formal ties with the medical school nor was the latter involved 
in its development. The two institutions have cooperated in the educational 
arena, however^ even prior to the initiation of this project , Within the 
first year of its existence the WO was host to medical and nursing students 
participating in a medical school sponsored elective j and several fourth- 
year medical students took an ambulatory care elective there. 

The two institutions work well together. The IMO team, consisting of 
the medical director and staff physicians, was responsible for curriculum 
content and design while the medical school was primarily concerned with the 
evaluation component. 

THE CUmiCULUM 

The AAMC project provided the two institutions an opportunity to develop 
a rational approach for introducljag education to the HMO and evaluating 
the results. An ideal course for this purpose was the preventive medicine 
course mentioned above for It enabled the evaluator not only to evaluate 
the student before and after the course, but to compare him with students 
assigned to other institutions. * 

The stated goals of the introductory course in preventive and community 
medicine were that students learn about the role and responsibilities of 
primary care physicians In preventioni the relatlonehlp between availability, 
accessibility, coat, and quality of care | the incidence, magnitude and 
severity of a health problem^ and the psychological ^ political, economic 
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and social relationship to illness and the delivery of health iervices. 
Each student was assigned to a health or social service institution for 
one-half day per week for fourteen weeks. Participating institutions 
Included institutions such as the Association for Retarded Children, an 
inter-'city neighborhood health center. Planned Parenthood , a venereal 
disease clinic ^ a family court, and GVG^. Students met for a series of 
seven lecture^seminars and combined exercises called "recall" sessions - 

A total of twelve students chose to be placed at GVGHA in the spring 
oeraester of 1975, It was for these students that a curriculim was con^ 
s true ted, field tested and evaluated. Aside from the overall course 
objectives, the study group defined additional objectives for the students 
assigned to GVGHA* They included learning WO concepts and changing atti- 
tudes concerning primary care and HMO practice* A detailed list of the 
cognitive and affective objectives as well as other components of the 
curriculum are presented in Resource Paper 3* 

The students met at the Wilson Center one-half day per week for 
fourteen weeks, with each session divided into three parts. The first 45 
minutes were devoted to one-to-one interviews between the student and a 
department head* By the end of the semester, each student had personally 
interviewed the chiefs of the departments of medicine, pediatrics, ob/gyn, 
eye services, urgent visit clinic/surgery. X-ray, laboratory, business 
office, pharmacy, and medical records/conttiiunications center* 

The students then convened for a one-hour seminar to discuss an WLO- 
related issue or the case history of a student's patient. Most of the 



seminars were led by the medical director, although occaslDnally a guest 
lecturer was invited. The third part of the session consisted of an 
obser^atloti pariod with a physician prBceptor . Three students were mssi^ed 
to a patientj whom they visited with the preceptor at least once 
during the course and were reaponsible for presenting his/her case his-- 
tory* Detailed descriptions of the case histories as well as the aminars 
are also presented in Re s o ur c e Paper 3 . 

EVALUATION 

The evaluation design was developed with three major goals in mind* 
(1) to identify changes in knowledge and attitudei (2) to analyze correla- 
tions between demographic/personal characteristics and outcome meaBuree so 
as to identify possible predictors of cognitive and affective achievOTents| 
and (3) to compare the results with control groups* 

For comparison purposes, three groups of students , all of whom 
participated in the community medicine course p were selected. Group 1 
consisted of the twelve students based at GVGHA; Group 2, called related ^ 
consisted of ten students assigned to other primary care organizations; 
and Group 3, called non-related , was made up of students assigned to com--' 
munlty agencies not involved in primary care. 

toowledge and attitudes were tested with two pre^post tests, pre- 
sented as Parts A and B of Resource Paper 12 , and through semi-structured 
interviews with an evaluator. The personal characteristics assessed for 
correlation included sex, hometown sige, physician parentage, undergraduate 
major, Medical College Admission Test (MCAT) score and the Edwards Personal 
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Prefarenca Schedule which measuras flftaan normal personality character- 
istlca. At the complation of the course ^ all 33 students complatad an 
activity summary and a course avalMtlon forms also presented In Resource 
Paper 12 . To complament and validate the sources of avaluative information, 
the evaluetor attanded all seminars ^ conducted interviews , and observed 
student/patient Interactions. A detailed description of the evaluation 
mathodology is presented in Regourca Papers 10 and 11 , entitled An IMP 
Based Primary Care Curriculmn for First Year Medical Students - Design, 
Evaluation and Discussion , and . Issues and Methods in Curriculum Evaluation ^ 
respectively. The latter was published in the December 1975 issue of the 
Journal of Medical Education ^ and the former was recently submitted for 
publication in the same journal* 

Using a variety of sophisticated statistical techniques j the evaluator 
found that there were few significant differences between pre and post test 
scores within a group or among the three groups. As anticipated, the GVGHA-- 
based students made considerable progress in their knowledge of and attitude 
towards IWOsi but the experience did net produce any great shift in Individ-- 
ual career plans. The career choice results showed an overall general trend 
among all groups towards various forms of prlinary care, Mi analysis of the 
student activity forms indicated that the GVGHA group had more patient and 
provider contact than the control groups. 

COSTS 

A consultant to GVGHA conducted a cost analysis and determined that 
the course costs GVGHA a total of $1,8805 or npproKlmately $157 per student 
per s^ester. The coste IncluJe the extra Btai time needed for student 
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teaching p but excludes overhead and space coats. Space costs were not 
included because the conference room used for the seminars is not presently 
used to capacity. 

To determine the extra staff time needed for teachings sample studies 
were conducted In the Pediatrics Department and the Urgent Visit Clinic* 
Preliminary data indicated that students caused little disruption in 
patient care. For examples in the Urgent Visit Clinic It took 140 minutea 
to see 9 patients without students present and 144 minutes with students 
present; in the Pediatrics Department It took 43 minutes to see 5 patients 
without students and 51 minutes to see a comparable set of patients with 
students present. 
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Chapter 4 
UNIVERSITY OF PEMSYLVMIA 
and 

?Em ITOlM HEALTH MAINTENANCE ORGANIZATION (PENN URB) 

The major accompllslunents of the University of Penneylvanla groups 
dascrlbed in the enclosed resource papera, include the development of a 
unique iterative curriculum planning process involving educators , clini^' 
clans j and other prof essionala; the preparation of curriculum modules; the 
design of an evaluation methodology and related instrtdaentsi and fiel*^ " 
testing of the curriculum and evaluation instruments. The curriculum 
development process developed by the group is described in ReBOurce 
Paper 1 ^ entitled Designing a Curriculum in a Clinical Setting: An 
Iterative Process ; the curriculum itself is presented as Resource Paper 4i 
and the evaluation methodology together with evaluation instrumants are 
presented as Resource Paper 9. Since these papers aptly present the 
group *s achievements I this chapter is brief* 

Penn Urb is a multi-disciplinary primary care center sponsored and 
supported by the University of Pennsylvania ^ although it is legally a 
separate entity* It opened for services in 1974 in a small (5, 500 square 
feet) renovated facility and presently provides 18,000 patient visits per 
year on a pre-paid capitation and f ee=f or=^servlce basis* 

The project was managed by Penn Urb under the direction of its medical 

director and with the active participation of the entire professional staff 

■ 

Day*-to-*day project activities were coordinated by a medical educator. 



Both the curriculiwi developmant process employed by the U.P, group and 
the curriculum they designed were unique in several respects. The develop- 
ment process involved educators and clinicians and the entire professional 
staff of Penn Urb. From the beginning the currlculm was designed in 
modular form so that any module could be added to existing courses or ^ for 
that matter, removed from the currlcul™ if taught elsewhere. 

The modules cover virtually all concepts that one can learn in an ffilO. 
They include: 

- primary and comprehensive care 
the health care team 

- ' consumer participation 

quality of care 
economics of HMOs 

- change and innovation 

A task force consisting of at least one educator and one provider was 
established for each issue with responsibility for defining behavioral 
objectives, recommending methods of instruction, developing a bibliography 
and identifying prerequisites. The curriculwn development process Is 
described in detail in Reaource Paper 1 , and the curriculum Itself Is 
presented in Resource Papej^ A * 

The curriculum was offered as a field test in an incsr'-sesslon course 
entitled Introduction to Comprehensive Health Care Systems , The course is 
an intensive one-week, 35 contact-hour ^perlence offered to medical, 
nursing, allied health professions , health. care administration, and social 
work students twice a year during Inter-sessions* Sections of the curriculum 
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were also fields-tested with one medical etudent who clerked at Penn Urb 
one session per day for four weeks. 

To assess the effectiveness of the curriculum, a series of evaluation 
instruments were designed and field tested in the inter^eession course. As 
indicated in Resource Paper No> 9 | Report of Efforts to Develop a_ Standard^ 
ized Test of faiowledge and Attitudes Relevant to the HMO Setting^ the evalua- 
tion methodology and related tools were designed for applicatllity in other 
WiO settings. Although this effort was organised by the Penn Urf^s tali , t^ 
other institutions participating in the project also contributed to its 
development. 
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Chapter 5 
THE mVEMlTY OF WASHiNGTON 
■ and 

GROUP HEALTH CMPEMTITO OF PUGET SOUND (felCPS) 

A uniqiia feature of Group Health haa been its Involveroent in student 
education almost aince its inception 30 years ago. Training programs for 
medical students and residents had been operating at Group Health several , 
years prior to the initiation of this project* Hencep one of the fir^^ 
tasks was to re^ew and assess these programs , and more iii^ortiwtly , to 
attempt to determine their costs* The mjor accomplishment of this project 
included a survey of eKtstlng medical student courses | the development of a 
curriculum for a thlrd-^year clerkship j the preparation of aa Integrated set 
of evaluation instruments | and the Initiation of a cost study, 

BACKGROIMD 

In the past ten years the University of Washington has been increasingly 
focusing its attention on the problem of maldistribution of medical resources 
and the training of primary care physicians. A major eurriculmn revision took 
place in 1968 and the Department of Family Medicine was established in 1971* 
More recently the University became a regional center In medical education by 
establishing the WAM program ~ acadeMc sites in the states of Washington^ 
Alaska, Montana^ and Idahoi devoted to primary care service and training* 



nia outcome of these efforts has been that mora thra half of the 
graduating medical itudents are entering primary care training programs, and 
the entering claas has been increased from 85 to 175 students* As a result , 
th:e medical school has found itself in need of additional clinical training 
sites in prima^ care* Group Health Cooperative of PugetSotmd, with its 
strong orientation towards priory care , represents m important clinical 
teaching resource. 

Group Health is a nonprofit t Conaumer--owned cooperative established 
in 1947 and presently serving approximately 200,000 members. It owns and 
operates nine outpatient facilities and a 300-^bed general hospital with a 
staff of 2^700* including 200 physicians, ^ ^ 

Group Health has been involved In student education almost einbe its 
inception* Over the years, educational programs have e^anded to such a 
degree that one of the first actlvltlee of this project was to identify 
the extent and scope of education at Group Health, Medical students have 
been training at Group Health for over 12 years, although the bulk of courses 
for medical students were not initiated until 3 years ago. The first family 
practice residency training program was initiated in 1973 with the sigiing 
of a Memormdum o£ Understanding between the University -s Department of 
Family Medicine and Group Health. The Memorandum, presented as Appendix 5 
at the end of this chapter, provides for the eKchange of family practice 
residents for training at each other's Institution and for medical student 
teaching at Group Health. 
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The AAMC-aponsored project was welcomd by the University and Group 
Health as an opportunity to eKanlne the HMO^s role in the education of 
raedical students and to develop, if possible, m Integrated, coet^ef feetlve 
curriculum. Specifically , the major objectives of the study werei 

To conduct a survey and evaluate esda ting medical student 

courses at Group Health | 

- If necessary, to develop a coinprehenslve curriculim that 
could be applicable to other HMO settings | 

^ To develop appropriate evaluation Instruments for assessing 
the curriculum's ef fectlveness i Mid 

- To eKamine the costs of rosdical student teaching at Group 
Health so that future progress could be "designed In a cost-- 
effective manner* 

The study was conducted jointly by both Institutions, with the medical 
school's Assistant Dean for Curriculum and Group Health's Director of 
Medical Education serving as project co--directors . A major role was assigned 
to educators from the Dean's Office of Research in todlcal Education, who 
provided consultation In research design, currlculOTi development md evaluation 
and teaching methodology* Two physicians, one from each institution, collab- 
orated in the cost study* 

SURVEY AND EVALUATION OF EXISTING COURSES 

The survey of existing courses at Group Health revealed that over 
570 students, Including students in nursing, public health, medical technologj?, 
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pharmacy and medical students from 11 Institutions were training at Group 
Health facilities. Of these, 180 were medical students enrolled in seven 
different courses, as shown in the table on the following page. The first 
four of these courses were selected for careful study and evaluation* 
Since there was insufficient time to evaluate all seven courses, only those 
with the major impact in ten^ of time commitmant, nurisera of students, or 
those offering a mique experience to medical students were chosen for 
investigation- 
Prior to the initiation of this study, the University already had a * 
well established evaluation system for many courses In the medical school 
and at Group Health, Such an evaluation system typically Included three 
components i 

(1) Evaluation of the course - by students, faculty and a course 
committee i 

(2) . Evaluation of faculty ^ by students, course committee and 

faculty self-- ratings, 

(3) Evaluation of student performance - by the preceptors, 
patients and student self-ratings* 

As part of this study, the evaluation systems of the four courses were also 
Investigated to assess their effectiveness and identify possible problems 
or flaws- 

The reassessment indicated that the courses provided students with a 
useful primary care experience and that students and faculty alike were 
pleased with the ea^erlence. It should be pointed out that the courses 
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UNIVERSITY OF WASHINGTON 
MEDICAL STUDENT TEACHING AT .GROUP HEALTH 



Total ; I days/yr ; 

Med Length of Number of number of students at,v 

student GHC Association students Time Involved for students in Group Heal. th,. 

year Departnient (years) per session each student past year x ^of student 



1 Outpt - FP 3 O-e/quarter l/2:day/wk/quarter 12. 66 :| 

2 Outpt - FP 1 ' 3-4/year 1/2 day/wk/e qtrs. 4* 60 .fg 

3 Radiology 4 0-4/mpnth 1 day every 2 wks 15 32.^ f 

for 4-6 weeks -o- ■• 

1 Hospital' 2 124/quarter 2-3 1/2 days/quarter 124 372 ;. 

, , for 3 quarters- , ■ 

'- 3-4 Ob-Gyn 1 3/4 weeks 4 weeks ■ 8 sessions/ 13 \360 , 

quarter ; 

3.4 Peds 12 0-2 varies: 1/2 day/wk - t quarter _ B 25,. . ; 

5 days/wk - 4 weeks 
5 days/wk - 1 week 

« .: '. 

j31*^ 1,4 HS 531 3 0'^ ysflf'S variable amount of 2 — 

time at Group Health , . 

'iOTE: *■ 1 student only present for 2 quarters. iBj 

*^ This is a crude attenipt to measure quantitative impact (i.e., 1000 = 10 students present for ■ 
100 days or 100 students present for ten days).' 

*^ See Appendix B - 401 - Introductory • •; 



* 493 denotes 4th year electives In clinical or lab medicine 

.*-' 465 denoted, basic clerkship in ob-gyn, med, etc. (3rd - 4th year), 
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were not designed to teach the unique features of HMO practice, but rather 
to provide a primary care es^erlence. Since the courses have been offered 
for some time and will be continued in the future, they are described below 
in some detail. 

!• Introduction to Clinical Medicine CHuman Biology 413, 422 and 435).' 

These three sequential courses , each one quarter of a year in duration 
are required of all first year students and are conducted largely at 
Group Health Hospital. Kiey provide the studentB with their first 
exposure to patienta rad are designed to Introduce basic skills in 
Interviewing, history taking and physical eKamlnatlons, The courses 
Involve didactic, demonstration and es^eriraental techniques, and a 
series of patient Interviews. 

Instructional strategies' Include an extensive syllabus of printed 
material covering all aspects of the medical Interview | conventional 
didactic presentations! small group discussions with the preceptors; 
and an intensive orientation week with lectureSp demonstrations, small 
group discussions, interviews with paid actors, and audlo-^vldeo tapes 
for performance evaluation and lecture demnstrations. 

The evaluation system features stu^ent'-^deslgned and administered 
questionnaires and extensive student-faculty coordination. During 
the previous two years, evaluation focused on the adequacy of the 
course objectives, Instructore, and learning resources, and self- 
ratings of skill and satisfaction. On the whole, the students were 
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highly satlifled with the courias and felt that they were momm of the 
most valuable coi^onents of the first year curriculuni. Facul^ 
evaliiatlon was also highly favorable md no changes were proposed, 

2p Family Medicine Preeeptorghlp (Family Medicine 401). 

This is a one quarter elective for first year studentSp in which 
the student observes a practicing physician one-half day per week 
and is Introduced to concepts of family practice. Approximately 
15^25 students elect the course each quarter* During the 1975 winter 
quarter^ six of 25 preceptors were Group Health physicians and eight 
students were assigned to Group Health facilities* The other precep- 
tors were solo practitioners or physicians practicing in other settings. 

The evaluation procedure for this course consists of a brief, open^ 
ended questionnaire in which students evaluate their preceptors, identify 
positive and negative features of their preeeptorship, and provide sug^ 
g est ions for improvement* This provided an opportunity for comparing , 
the results and performance of students a;t Group Health^ with those in 
other settings. An analysis of the student questionnaires, however. 
Indicates that there was little difference in the responses of the two 
groupe. 

3. Family Medicine Continuity Clerkship (Pamily Medicine 420,421, and 422). 
This new course, offered for the first time in 1974^75, is designed for 
- second year students, most of whom take it for three consecutive quarters. 
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Students meat with a practicing physician one-half day per week and are 
given the oppDrtunity to work up and follow selected patients , Site 
experience is supplemented with weekly university--based lecture /discussi 
on various aspects of fmily practice. Of the 24 students taking the 
course last year^ four were assigned to Group Health preceptors. 
Course objectives include exposing the student to the concept of 
continuity of care and simple office procedures- Preceptors generally 
try to guide the student toward clinical practice so that by the end 
of the course the student functions in this capacity about 50% of the 
time* 

A comprehensive evaluation system was developed for this course util- 
ising input from students, faculty and patients. The system consists 
of six components J 

(a) Daily activity logs completed by students * 

(b) Site vislta by preceptors; 

(c) An open-ended evaluation questionnaire completed by students; 

(d) A student evaluation form completed by the patient; 

(e) A productivity impact questionnaire completed by the preceptor 
for identifying productivity loss and teaching preparation time; 

(f) A student performance fora completed by the preceptor in which 
the student is rated on dependability, initiative and interest, 
ability to communicate with patients, relationships with patients 
and staff, and competence in eliciting and synthesliing information 
from patients. 
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The resulting evaluation data was analyzed to examine differences 
between the ffllO and other settings. It was found that the only signi- 
ficant difference was In productivity loss. Group Health preceptors 
showed a productivity loss of 62% or 6*2 patients per 3 hour session, 
while all preceptors (including Group Health preceptors) averaged 
a productivity loss of 25% or 4 patients per session. Preparation 
time was also greater with Group Health preceptors who reported an 
average of 50 minutes per week of preparation , while all preceptors 
reported an average of 30 nlnutes. An analysis of the student activity 
logs revealed that Group Health students saw fewer patients, but 
tended to receive more intensive eKposure and were allowed somewhat 
greater levels of responsibility* 

4, Independent Field Study (Public Health and Conmunlty MedicinSp PH--CM 531) 
This is an Independent study elective which relies heavily on one to one 
discussions between student and preceptor. The student and faculty ad;^^ 
visor arrange for special projects at community health agencies such as 
Group Health, 

THE PROPOSED CURKICULmi 

The University and Group Health held a series of joint workshops to 
consider the results of the survey, to discuss the University's training 
needs, and to construct a curriculum best suited to the needs of both instl" 
tutions. It was decided to develop curriculum for an intermediate clinical 



clerkship designed for third year students who would spend approximately six 

Weeks full time in the ffilO. In addition, It was decidad that the major thrust?^* 
of the currlculim would be on the development of clinical skills and knowledge i}^ 

- ■ : ' , ■ \ ' ^ ■ ' fi 

which could be most effectively and effictently taught in the ffllO but which 
are not necessarily unique to it. A complete and detailed outline of the 

course including goals and objectives, instructional methods, and evaluation ' 

^ ■ " ■ 

methods, are presented as Hesource Paper 5. • While this currLculiai was dealgnsd;"^^ 

^^^^^ . . - - ^^j^-^ 

primarily for third year clerkships, sections of the currlculinn might be ^ 
used In other eKistlng courses. ^-^^ 

Group Health is examining the possibility of offering other clinical 
courses, A list of approKimately 90 courses presently offered by the 
medical school in other clinical settings has been circulated to Group Health' ^ 
preceptors to Identify those courses which can be effectively taught at 
Group Health* 
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PROPOSED EVALUATION INSTRIMNTS . 

In conjunction with the proposed curricula, a series of evaluation 
Instruments i designed to evaluate the performance of both students and pre- 
ceptors, were developed and are presented as Efisource Paper 13* The author's 
description of these Instruments Is presented on the follywing pagSi 

SUIMARY OF COST STUDY 

The proliferation of educational progrms and courses at Group Health 
was a primary motivating factor for undertaking the cost study. In fact, 
the University had originally proposed to do only a cost study i and to do It 
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DESCRIPTION 01 PROPOSED EVALUATION INSTRUMENTS* 



1) Completed by the Student. 

Exhi bit 1: Student Log Record i no Form and Computer Summary Report. 
Students will be asked to log pa^ti en t problems ana procedures enco un t- 
ered in the clerkship experience and to submit the logs on a weekly 
schedule. At the end of the clerkship, the students and preceptors will 
receive computer-generated summaries of the student's individual experience 
A summary report analyzing all student-patient encounter experiences will 
also be produced. These reports are to be used by the various course 
coninlttees to assist them In their evaluation of both the course and 
faculty. They are to be used by the faculty for the purpose of self- 
evaluation and by the student as a record of accomplishments. 

Exhibit 2: Student Progress Report . 

Approximately midway through the quarter students will be asked to com- 
plete this brief form to help the course committee and preceptors eval- 
uate the course from the students' point of view. 

Exhibit 3: Student Course Evaluation . 

This form Is to be completed by students at the end of the course to 
evaluate the course's strengths and weaknesses. 

Exhibit 4: Student Assessment of Preceptor and Training Site. 
This form will also be completed by the student toward the end of the 
course and Is to be used , for evaluating the preceptor and training site. 

2) Completed by the Preceptor 
Exhibit 5: Preceptor Progress Report. 

This brief report is to be filled out periodically as an Informal method 
for the course committee to keep abreast of the course from the preceptor's 
point of view. . 

Exhibit 6: Course Achievement/Grade Report. 

This will be used by the preceptors to rate student performance on each 
instructional objective and on selected professional attributes. It 
should serve as the principle medium for documenting student achievement. 

3) Completed by the Patient 

Exhibit 7: Patient Feedback to Students. 

This form provides the means, for patients to record their impressions of 
students and for students to evaluate their ',iwn strengths and weaknesses. 
This form should be used sporadically or in nome way mutually determined 
by preceptors and students. After a few weeks in the office, students 
In other settings have appreciated the reassurance that has come from 
patients' positive remarks on these forms. 

4) Completed by the Course Committee. 



Exhibit 8: Si te Visit Report ^ ^ i 

Th is form outlines the procedu re:, involved in a site visit by the course 
administrators to a preceptor's nffice. Since time may not Pennit a 
site visit to each office, they ulll probably be conducted on a random 
basis or in response to reported or suspected problems. The visits and 
reports thereof, are used to fad 11 t- te evaluations of the course and 
the preceptors. 

*Sourc*. J The University of Washington i ;lr; M report . 54 
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for medical students only. However, at the urging of the Project Advisory 
CoiranitteBs the university agreed to expand the project md also include a 
cost analysis of its faMly practice residency training programi The study 
is presented in its entirety as Resource Paper No. 15 * 

The study presents cost data for the msdlcal student courses described 
above and for the fand^ly practice program. Costs that are easily measured ^ 
such as salaries 1 spaces equipment, and supplies ^ and costs and benefits 
not so easily measured^ such as job satisfaction and iB^acts on quality of 
care and enrollment, are discussed. Data was collected by a variety of 
methods including structured interviews with preceptors s students, adirinis^ 
trators and consumers ; questionnaires; clinic records; daily activity logs; 
and a time-TOtion study, A summry of the data for medical students is 
presented in the table on the following page. Data for the family practice 
residency training program is presented in Table y-6 of Resource Paper N o* 15 
The annual cost of training one resident was found to be approximately 
$15,000. However^ this does not appear to include the value of the resident 
services performed in the "coverage" setting. As the authors themselves 
indicate, this study is preliminary in nature and both the conceptual frames- 
work and data need additional refinement, ^ 
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Cost of Madlcal Student Teaching 
Gr Quo Health CQOoeratlva of Puget Sound. Seattle , Waihington 

1974-1975^ 



Gourie 


Student 
Level 


Student 
Activity 


Number of 
Studtnti in 
Course 


Cost per 
Student-day 


No* of Student 
Days* In Xw 


Totsl^^Coat 
€f Csurse 
to the HMO 


ogy 413 


1st year 


1- — ' 

interviewing 
patients 


' 

175 students 


0 


Not available 


0 


iclne 401 


1st year 


observing 
pliyiiclu in 
practice 


8 


§4i30 


50 




Iclne 420 


2nd year 


interviewing; 

patient 

examinations 


4 


79*80 


59 


4,708 ■ ' 


iclne 
ed) 


3rd year 


advanced 

patient 

gxaminatloni 


1 


53.20 


40 . 


2,123 


Medicine 531 




research 


1 


($10,00) 
net benefit 
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APPENDIX 5 



MEMORANDUM OF UNDERSTANDING 

University of Washington School of Medicine 
Group Health Cooperative of Puget Sound 



Whereas Group Health Cooperative of Puget Sound and the University of Washington 
School of Medicine share coimion goals in the education of family physicians and 
whereas both have already instituted educational programs for family physicians 
in training, therefore agreement has been reached between the two institutions 
to share effort and resources in approaching these goals. 

Group Health Cooperative is a true consumer cooperative providing a full range 
of medical services to its members. It recognizes benefits to its members from 
participation by its professional staff in residency training— and especially in 
family practice residency training—because its pattern of medical care delivery 
has depended for many years upon the use of family practice primary care physi- 
cians. It provides j therefore, a successful real -life operating model of the 
new academic medical discipline of family practice. 

It should, be noted that the following educational efforts already exist at Group 
Health: j f 



1. A fully approved family practice residency geared to produce two 
graduates per year. 

2. Group Health physicians serve on the volunteer clinical faculty of 
the medi cal school . 

3. University of Washington medical students on elective family med- 
icine preceptorships are assigned to individual family physicians 
at Group Health, 

4. Pr/yiicans from Group Health serve on the Family Physician Pathway 
Cci,riittee of the Medical School and serve as curriculum advisors ' 
to students. 

Also, uhf University of Washington School of Medicine already has instituted the 
fol lowl ncj efforts : 

1. Topics and concepts of particular relevance to family practice have 
been included in the basic medical school curriculum. 

2. A Family Physician Pathway has been implemented in the ell hi cal 
curriculum. 

3. A Department of Family Medicine with full-time faculty and staff 
was established in 1971. 

4. Clerkships in the discipline, family medicine, have been developed. 
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5, An accrcHlUoU Fcniiily PracticG Uusiduncy Procjram based at the Unlver- 
siLy Hospital beydn July, 1972. 

6. A spt^cially desiynod Fdinily Medical Center has been built at the 
University Hospital to serve as a clinicdl model for the above pro- 
grams , 

The University of Washington, through its School of Medicine, now agrees to pro- 
vide for Group Health Cooperative of Puget Sound the following: 

1. Assistance in obtaining educational opportunities for Group Health 
family practice residents, particularly 1n fields not represented 
at Group Health, such as behavioral and social sciences ^ certain 
sub-specialties of medical disciplines ^ and opportunities for devel- 
oping exchange arrangements with other family practice residency 
programs or teaching units affiliated with the University. All 
formal conferences and lectures developed at the University of 
Washington for University of Washington family practice residents 
will be open to Group Health family practice residents* 

2. Payment to Group Health is the amount of $20,000 per year, payable 
in four equal quarterly installments, for purposes of carrying out 
this mutually beneficial agreement. 

Group Health Cooperative of Puget Sound agrees to provide for the University of 
Washington School of Medicine the following: 

1. Opportunities for University of Washington family practice res- 
idents to be assigned to Group Health Hospital and Clinics for 
portions of their training in the unique setting of a prepaid com* 
prehensive group practice* 

2. Making available the facilities and resources of Group Health for 
development of clerkships in family medicine. It is understood 
that a clerkship of the magnitude of Family Medicine 465 (as now 
exists In Omak and Grandvlew, Washington, involving two student 
positions regularly throughout three of the four quarters each 
yGar) is beyond the terms of this agreement, and the development 
of such clerkships at Group Health Cooperative would be contingent 
upon additional financial support by the University* 

3* A Group Health physician staff member will be appointed as Director 
of the Family Practice Residency Program at Group Health and will 
devote at least half time to this position* This physician will 

chosen by Croup Health subject to the concurrence of the 
Chairiiian of the Department of Family Modi cine and in accord with 
the Faculty Code of the University of Washington. He will be 
appointed to an appropriate faculty title and rank without tenure 



Appendix 5 (continued) 



M of U between UW and Gil 
Page 3 



in the Departmorit of Family Medicine. Ho will be a member of the mecl- . 
icQl staff at Group Health with the usual rights, privileges, obliga- 
tions and frinqe benefits that accompany that status. He will be 
responsible throuyh the Director of Medical Education and Education 
Committee to thu medical staff of Group Health. As a member of the tac- 
ulty of the Donartment of Family Medicine of the University, he will be 
responsible to the chairman of that departnent and serve in his faculty 
position at the pleasure of that chairman and in accordance with Univer- 
sity rules and regulations. Ho will be expected to participate in 
teaching and administrative functions of the department consistent with 
the departmental objectives for family practice education. 

4. Agreement that rules and regulations of the University will apply to 

the faculty member based at Group Health except where a mutually agreed- 
upon exception is made, and that these will likewise apply to Group 
Health residents when they are at the University. Similarly, residents 
from the University will abide by Group Health rules and regulations 
when they are participating at Group Health. Each principal will , how- 
ever, continue its full support of its own residents, including fringe 
benefits and malpractice coverage, without interruption while their res- 
idents are serving in a mutually approved activity at the other institu- 
tion. 

University faculty will be expected to provide equivalent training to residents f 
Group Health, and faculty-staff at Group Health will do likewise for University r 
Idents at Group Health, as each provides for Its own. Each will endeavor to make ^ 
available to the other's residents the unique training opportunities each can offer 
and do so on an approximately equal exchange basis. Respectiye faculty shall also 
be permitted to participate In staff activities at the other institution where 
that participation is appropriate to their teaching function. 

This cooperative activity between Group Health and the Department of Family Medlcin 
will affect other departments in the University and Medical School only insofar as, 
residents from Group Health will share the same opportunities for training expe- 
riences offered by other departments as Is open to the Medical School s own res- , 
idents In family practice. , . 

This anreement becomes effective upon the below written date. The Chairman of : 
the Department of Family Medicine and the Director of Medical Education at _ Group ^ 
Health shall review this agreement prior to each anniversary date and sulwii t a join 
report, or if Indicated separate reports, to both principals. The report shall ^ 
comment on; 

- general results of the collaboration and suggested additions on deletion 
from the agreement, 

- numbers of residents from each institution who have been involved with 
the other institution's program, 

- an estimate of the value of these Interchanges to the residents and to 
each Institution, 
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now directions the conaboration might take. 

iur party may terminate this agreement upon at least nine-months' prior written 
notice. 

Effectiv e Uate: January 1, 1973 



For the University of Washington; 



For Group Health Cooperative of Puget Sound 

Si 
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Chapter 6 
BROWN UNIVERSITY 
and 

RHODE ISLMD GROOT HEALTH ASSOCIATION (RIGHA) 

Brown's major achievement was the development and field-testing of a 
curriculum for the RIGHA component of a mandatory course in comunity 
medicine. Plans are also in progress for initiating innovative sleottve 
courses at RIGHA, The project was managed prtaarily by the Section on 
Coimnunity Health at Brown University and the RIGEA staff, 

BACKGROUND 

A two-year Master's Program in Medicine initiated at Brown University 
in 1963 became a f our-year medical school ten years later and graduated its 
first M,D* class in 1975, The medical school is unique in several respects 
First, it offers a medical curriculum conducted as a program rather than an 
independent school or faculty. Second, the program admits most of its 
students to a seven-year curriculum. Finally, it was planned from the 
beginning to rely on conrounlty-'based teaching facilities. Having no teach- 
ing facilities of its own, the University has entered into affiliation ^th 
local coimnunity hospitals and other health care institutions. One such 
institution is the Rhode Island Group Health Association (RIGHA). 

RIGHA is a labor-^sponsored, community-based pre-paid group practice 



*Brown University is the only one among the institutions participating 
in this project in which student ^perience in an WfO was mandatory. 
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plan which opanad In May 1971. It is located on the grounds of a local 
conmiunlty hospital (Our Lady of Fatlma Hospital) in a ISiOOO^-square-f oot ^ 
converted laundry facility* Additional office space is located in the 
hospital. As of December 1975 ^ it had an enrollment of 15 ^ 000 members and 
served an additional 2^000 persons on a f ea^-f or-service basis* RIGHA is 
partly supported by loans and grants from HEW and the Prudential Life 
Insurance Company. In 1973, facing severe financial difficulties j RIGHA 
entered into M management service contract with Prudential* Prudential now 
.operates the WIO and is represented on its Board of Directors together with 
representatives of organlEed labor and the public sector. In November 1975s 
RIGEA became one of the first IMOs to be certified under the IMO Act of 
1973. 

RIGHA' s interest in education dates back to 1973 when it signed a 
Memorandum of Association with the University (see Append Ik 6 ) . It views 
teaching as a learning experience for the preceptor as well as the student 
and believes it is a positive factor In recruiting top quality medical 
staff. The first educational eKperience at RIGHA occurred in early 1974 
when several clinical students spent a week there on an experimental basis* 
However s no program had been prepared for this purpose. The AMC program 
was viewed r an opportunity to design a well-planned and rational curricu^ 
lum for teaching medical students in the HMO setting* 

THE RIGM ROTATION IN Tlffi COmJNITY HEALTH CLERKSHIP 

In the initial planning of the clinical curriculum^ no specific provl= 
sion was made for the teaching of primary care* The clinical curriculum con- 
sists of 48 weeks of required core clerkships (Internal medicines 12 weeks | 
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surgery, 12 weeks; pediatrics, obstetrics, psychiatry and co^tinity health, 
6 weeks each), 10 weeks of "selected" clerkships, and 24 weeks of open 
electives. When it became apparent that the major clinical disciplines were 
planning to use their core clerkships for the teaching of inpatient aspects 
of medicine, the section on coimunity health resolved to make the teaching 
of primary care one of its major objectiveSi 

The clinical student's major experiences in primary care are embodied 
in the Core Clerkship in Community Health, This course consists of four 
major partsi (1) patient work-ups at the Rhode Island Hospital Ambulatory 
Patient Center; (2) a seminar series on current issues in coimnunity healthi 
(3) an assigned Health Planning Problem in which students work in groups on 
laaues such as Planning for Obstetrical Care in Rhode Island, Meeting the 
Needs of Mentally Disturbed Children in toode Island, the Control of Hyper-- 
tension Among the Disadvantaged, the Problem of Malpractice, the Rehabilita-- 
tlon of Stroke Patients in Rhode Island, and the Problem of Meeting the 
Needs of the Terminally 111; and (4) a set of options ^ 1 to 2 weeks long^ 
such as a preceptor ship, a tutorial assigrmienti or a research project. The 
6--weak course is mandatory for all clinical students and has as a prerequi-- 
site the 12-week clerkship in internal' irfedicine. The community health 
clerkship is offered continuously throughout the year so that only eight 
students are enrolled at any one time. 

During the course of the year, a total of 64 third and fourth-^year 
students participating in the clerkship were rotated through RIGHA, After 
eKperajnenting with various formats, it was decided to restrict patient- 
student intact so as to avoid charges of patient ^ploltatlon* The current 
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RIGEA. rotation consists of a mandatory one-^day seminar and an optional 
one or two-week resaarch asalgninent on a topic of particular interest to 
the student and the medical staff. The saninar focused on three topics I 

(1) Structure and OrganiMtion of Group Practice and Philosophy of HMOs; 

(2) The History and Development of RIGHA| and (3) Basic IWO Concepts as 
They Relate to the Operation of RIGH4, To supplement the seminars a 
series of resource materials ware prepared ^ including an HMO Reader consist-- 
Ing of eight selected articles (see Appendix 7 ) and an BtlO Library contain- 
ing over 250 articles and monographs, 

PROPOSED ELECTIVES 

Brown and RIGHA also developed a series of electives for students who 
wish to expand upon their RIGM experience. The first elective, entitled 
Primary Care in the HMO Setting ^ Is a 4-"6 week course in which the student 
spends half his time in clinical practice under the supervision of a 
physician-preceptor 5 and the other half of the time on a special research 
project- The student may rotate through several clinical departments or 
stay in the same department throughout* A maximum of two students will be 
accepted at any one time. The course was approved by the curriculmn com- 
mittee in August 19755 and was offered for the first time in the 1976 spring 
semester. A similar elective is being developed in ambulatory pediatrics 
and will be submitted soon to the curriculum conmittee for approval* 
Finally, a third elective entitled Medical Managementi The Role of the 
Medical Director In the Ifl^O will be offered next year to students Interested 
in administrative medicine. Further descriptions of these electives are 
presented in Appendix 8* 



APPENDIX 6 • v;'i 

MSMORANDUM OF ASSOCIATION 

, between 

RHODE ISLAND GROUP HEALTH ASSOCIATION, hereafter called "the , | 
Health Care Facility" and BROWN UNIVIRSITY JffiDICAL EDUCATION 
PEOGRAMs ProYidenoep Rhode liland, hereafter called "the UniYerslty^ 

1. The Health Care Facility and the University hereby agree • 
that eooperative programi in medical education and research spon- : 
iored by the Univeriity and conducted in the Facility can be of 
mutual benefit and contribute to the broadening of educational 
opportunities in the University 's programs and to the betterment 
of the services offered by the Facility. 

2* The University is willing to accept responsibility for 
the supervision and direction of such programs as are from tlm^ 
to time mutually agreed upon* 

3. It is understood that the Health tiare Facility retains r 
sole responsibility for the care of patients, including all 
administrative and professional functions pertainiag thereto* 

Medical students partiQipating in such programs shall be 
selected by the University, 

5* Such programs shall be conducted only under the personal ^ 
supervision of a part-time or full-time member of the staff of 
the Health Care Facility vho shall be designated as the director 
of the programs. The director must have, the credentials reouired 
for faculty appointment in the University's Division of 3io^ 
logical and Medical Sciences , shall be nominated by the Health 
Care Facility, approved by the Chief Aaademic Officer of the 
University's Program in Medicine and appointed to the faculty 
in accordance with the rules, regulations and practices of the 
faculty. 

^ 6, The director shall be responsible for the conduct of 
programs within the Health Care Facility and shall report directly v 
to the Chief Academic Officer of the University's Program in 
Medicine in all matters relating to the teaching , training and 
supervision of medical students. 

7. The medical education activities contemplated by this 
Agreement include: ' 

(a) Participating In the Clerkship in Community Health 

(b) Such other educational and/or research programs for Vi 
students in the UniversityVs Medical Program as shall hereafter j| 
be mutually agreed upon, :™ 

8, The content of eduaatlon prngrams for students in the 
Univcraity's Program in Medicine sh^ll rsquir^ formal apprGVal of -i 
thiif Medical Council of the IJni ve vni ty and yhall be conducted 

only in clinicai areaa which havs swcin ixprewaly authGri::c;d by ; ' .V-^!! 
: tUe;,;governinG ..Poard o f ;thfl Hsa.Uh C^t& vFaatiity.^;^^^ 
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9- Continuing medical eduaation programs for praeticing 
physiciani shall be selected and organised Jointly by the Chief 
Academic Officer of the University's Prograa of Medloal EduGation 
and the authorised represen tat ive of the medical staff of the 
Health Care Facility, 

10. It is understood that the Univeraity is also a party to 
an affiliation agreemant with Rhode Island 'Hospital, Roger 
Williami General Hospital, the Memorial Hospital (Pawtucket)^ 
The Miriam Hospital, the Providence Lying-in Hoipitalj and 
Butler Hoipital and that its participation in the programs 
contemplated herehy shall at all times be subject and subordinate 
to the provisions of this agreement as the same may be from time 
to time amended. 

11. The Health Care Facility agrees at all times to maintaitt 
in effect public liability, errors and omission and malpraetice 
insurance policies having limits of not less than $5 million in 
which Brown University, its officer, employees, agents ^ faculty 
and students shall be named as insureds. 

12. The provisions hereof shall remain is effect until 
written notice of termination given by either party to the other 
not less than six (6) months prior to the effective date of such 
termination* 

IN WITKISS WHEREOF, this Memorandum has been executed in 
duplicate this /O^^ day of A^ctiM , 19^3. 




Pierre M. Gallettl 



Vice President (Biology and Medicine) 
BROWN UNIVERSITY MEDICAL EDUCATION 
PROGRAM 



'Rk^di. C^/m^^d Qie^^p Ht.mt4h ^w^. 
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Appendix 7 

THE HMO READER ^ 

"The Continuing Evolution of Health Maintenance Organisations,-- Gordon 
K. Macleod, M*D. , and Jeffrey A, Pruasin, M,D. The New England Journal 
of Medicine , 288i9 (March 1, 1973) i439-^443. 

This articles outline the key developments in the history of Health 
Maintenance Organizations Cl010*s)> starting with the recoraraendatlons of 
the Conmittee on Cost of Medical Care in 1932 and continuing through the 
twentieth century to its current level of popularity, Maclead and Prussin 
clearly describe the essential components of HMO's and briefly outline the 
evidence on ffilO effectiveness in meeting the current deficiencies of the 
health care system, 

"The Role of Prepaid Group Practice in Relieving the Medical Care Crisis," 
Ira L* Graanberg and Michael L. Rodburg. Harvard Law Review, 84 s 4 (February, 
1971) : 889-921. 

This section of the comprehensive report published in the Harvard Law 
Review briefly describes the current "health care crisis" and how the WiO 
can correct these problems. Also contained in this section is a valuable 
description of the organiEation and structure of health care delivery under 
the mo model. The concise definition presented here gives an excellent idea 
of the issues Involved in the establishment and management of an IWO, 
including such topics as patient benefits, compensation of physicians, and -m 
the type of hospital affiliation. The various organizational models are % 
Illustrated with descriptions of the ffiiO's currently in existence, giving 
a sense of where it is the IMO's are most successful • 

--mo Performance I The Recent Evidence," Milton Roemer and William Shonick, 
Milbank Me morial Fund Quarterly , Health and Society , 51i3 (Sunmer, 1973) f 
271-^317. 

Despite the fact that this study is somewhat dated, it remains the most 
comprehensive and objective evaluation of the evidence on ffliO and Medical 
Care Foundation (MCF) efficiency^ as it covers all of the following areas 
with respect to tWO performance i subscriber composition i participation 
of physicians* utilization rates* quality assessment* costs and productivity*; 
health status outcomes* and patient attitudes, Roemer and Shoniek, in 
additional to the new evidence they present, provide an excellent literature . 
review and bibliography on the subject. Perhaps the most Important 
sections concern the lower inpatient utilization rates in HMO's and the 
savings to the consumer when out-^of -pocket expenses under other plana are 
included* 

"Psychiatric Services and Medical Utilizar.lon in a Prepaid Health Plan 
Setting," William Follette, M.D. , and Nicholas A* Cummlngs, PhiD. 
Medical Care , Vil (January-February, 1967) 125-35. 

This study highlights the importance of the idea of comprehensive care ^ 
in an IMO In discussing the inter-relationship batween mental health 
servlceB and other medical services. Furthermore* the social origin of 
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lllneaa behavior is clearly Illustrated. Significantly, the results of 
thie study showed that a group of members of a PPGP with a high rate of , 
utilization ot medical services had lower rates after psychotherapy. In 
compariaon to this group, a sample of raemb ere with similar demographic 
background and utilization rates with no psychotherapy did nbc show a 
decreasing rate with time. These findings Illustrate another^ way in which . 
the HMO structure^improves upon the traditional private practice fee-f or- 
service mode of organization- ^ . , 

"Planning Healthi The HMO* s Opportunity Helen L. Sraits . Inquiry, XII: 
(March, 1975) i3-9, . , 

Perhaps because of the current economic atmosphere, discussion of the pros 
and cons of prepaid group practice are too often focused on the ffionomic 
advantages and Ignore the other facets that went into the mO philosophy. 
SmitsV article is an important corrective of this. The author points to 
two factors, namely, working with a defined population arid a predictable 
income* which make the IMO setting uniquely suited for ^'genuinely 
participative planning which involves both providers and consumers." In 
addition, the HMO presents an ideal setting for the continual dissemination 
of current medical information. Finally^ Smlts emphasizes the need for 
collaboration between the consumer, the provider, and other health 
professlonali an emphasis too long neglected, 

"The Health Maintenance Organization Act of 1973 (P. L,. 93-222) and Prepaid 
Group Practice Plans," Joseph Dorseyi M.D. Medical Care ^ XII il (January, 
1975)11-9. . 

This article contains a step-by-step evaluation of the 1973 mO Act, which 
represents a culmination of federal interest In HMO^s. Dorsey clearly 
outlines the benefit package an mO must provide In order to qualify under- 
P.L. 93^-222, and he describes how these strict regulations will be a 
disadvantage for mO'Q attempting to compete with the traditional Insurers* 

"Should an HMO be an Integral Part of the University Medical Center?" / 
Gerald T. Perkoff, M.D. Journal of Medical Education , 48i (April, 1973) 
Part 11:67-72. 

Dr, Perkoff 'a moat valuable point is that the HMO Is uniquely ^suited to 
fill the "gap between trainings practice, and societal needs." That is, 
medical school focuses the students! attention on specialised skills rather 
than attending to the actual needs of a population. The problems Perkoff 
describes in achieving such an HMO-university relationship are both 
philosophical and financial. Throughout his discussion, his ultimate 
goal is to "make the transfer from student to practitioner more effective 
This kind of philosophy is important to understand In discussing the current 
ef torts to Integrate experience In primary care Into the medical school 
education. 

"Critical Issues in the Assessment of Quality of Carei Their Relationship 
to mO'si" Robert H, Brook, M.D.. Sc.D. Journal of Medical Education, 
48l (April, 1973) Part Ilill4-134. 

The relationship between quality of care and the mO is an Important one 

to consider becausa of the unique opportunities the organlEation of services 
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in an HMO presents. Brook discusses at length some of the key Issues fg| 
involved In the current debate over the methodology of quality assessnent;;f| 
Including a critical review of some of the recent literature on the subj,ec| 
of structure, process, and outcome modes of measurlni quality and the- '"i 
evidence on quality of care in IWO's. Brook maintains that the prepaid ..^ 
group practice presents an excellent setting in which to develop "new =^ 
and more appropriate methods for assessment of quality of care.' Moreover^ 
from the point of view of the ™o, quality of care studies must be Initia^i 
in order to determine If the mO does Indeed represent an Improvement 
for the health care delivery system. v.'?i 

. ■ ■ ■ ; . r-M 
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'time* Each student must be interviewed by RIGM staff prior to aceeptance ' 
into the clarkship, ^ 

Curriculim , 

- . ■ . V" '=A 

The elective consists of two activities run simultaneously* During half > 
of the student's timep he or she will be assipied to the medlcalp surglcali v:.^) 
pediatrlep and obstetrician/gyneaa logy departments* The student will be ass- ^ 
ipied to one clinical preceptor in each department* A clerk may choose to Z.^. 
remain within one department or to have more emphasis on one department rather ^x 
than to rotate through all. , ; 

During the preceptorshlp eKperlencei the student will have clinical 
reaponslbilitles for patient workups* The preceptor will assign cases with 4; 
particular emphasis on those which demonstrate primary care problemE, '''t\ 

Each instructor will develop an individualized program with each studant.; ' 
However J at this time there are no plans to develop Individual faculty-student;^ 
contractual relationships as structured at many other schools. 3 

The second part of the elective will be devoted to a small research proj- , 
ect on one area of primary care delivary at the ffllO. The field experianca j; 
described elsewhere has proven the feasibility of assigning to a student a ; 
health care projectp given raasonabla Idjultations on the scope and nature of - 
projects chdsen. Examples of such projects ares quality assurance studies » y 
health education programs, design of screening programs p and evaluation of 
treatment programs for specific disease entitles* The projects will be In 
the area of the student -§ own personal, career Interest and will be primarily 
clinical In nature. Each student will be assigned a preceptor to help plan 
and review the project* Each student will present the results at a staff 
meeting at RIGIU which will be attended by Cosmunlty Health faculty. _ 
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FOimTH YEAR ELECTIVE IN PEPIAIEICS AT RIGHA 

A growing need has been felt at Brown Medical School for clerkships In 
ambulatory care settings. RIGHA will participate in a new fourth year elective . 
In ambulatory pediatrics beginning in 1976, The proposal for this elective 
clerkship la outlined In this section. 

Although tha elective will focus only on pediatrics, the RIGHA clerk will ; 
participate In Mny of the same activities at RIGHA as will the clerk In pri- 
mary care. The student will learn the basic skills of ambulatory pediatrics 
as defined by the course sponsors ^ but in addition, the student will be ex^ 
pected tot 

1. Participate In an Independent study focusing on some clinical ped* 
latrlc problem at the HMO Ce#gi,^ — Immunisation levels of the pop- 
ulations adolescent obesity problems.) 
2* Define the differences between pediatric practice in the ffilO setting and 
in private practice through observation of private practices as well 
as the RIGHA progrmi* 
The RIGHA participation in the ambulatory pediatric program will serve 
as the model for its participation in ambulatory teaching programs through 
other departments* If successful > an attempt will be made to define clerks- 
ships or other shorter learning modules in which specific skills in ambulatory 
care could be developed in the departments of surgery, ob/gyn, and other major 
specialties such as or thopedlcs, allergy , and psychiatry. 

Evaluation of this ^oupse will be at two levels* The RIGHA evaluation 
program as developed through the Section on Community Medicine will be comb« 
Ined with an evaluation by the Pediatric section using their own techniques. 

Costing methodology will be the same as described under the section on 
costs. 
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FOURTH YEM ELECTIVE IN I^DICAL MANAGEMENT AT RIGHA 
Over the past several years/ there has been an Inereaslng demand for 
phyalclans to serve In planning rad administrative funetlons- This demand 
Is due both to the growth of organizations such as ffilO's to deliver care and;:; 
to the growing need to atructure tha entire health delivery system. \ \ ,* 

The physlelan/adralnlstrator or planner must have sufficient clinical 
knowledge to be accepted by other physicians as a peer and to assure sound 4^ 
clinical practice In delivery programs. Such a physician serves populations 
much as Che clinician serves individuals. 

The physician-administrator requires skills and knowledge which are 
seldom taught within the medical school years. The sciences of management 
fiscal administration, planning, and other related fields have grown suff- 
iciently to warrant the attention of physicians Interested in administration^ 
The historical pathway of assuming administrative posts following years of 
distinguished clinical practice must be replaced by specific graduate train- 
ing programs paralleling or following clinical residencies. Such programs 
are evolving in many schools* particularly In schools of Public Health; But 
it is also reasonable that undergraduate medical students ba introduced to 
the problems facing medical administrators and to the approaches they use 
in solving them* 

It is the Intention of the Section on Conffiiunity Health working in coli*^ 
aboration with RIGHA to offer an elective pracaptorship to senior medical 
students that would focus on the role of the medical director of an mO, 
This elective program would offer the student tha opportunity to become fam- 
iliar with the administrative functions of a medical director and thus to 
develop an undarstandlng of the problems and tasks facing a physician adra* 
Inlfltrator, 

■ 
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The elective will be a ahort clinical clerkahlp. The student will he 
assigned to the RIGHA medical director tot a one-month period. During that 
time, the student Willi . ■ 

1. Observe the medical director— attend meetings, sit in on project 
planning sessions, etc. 

2. Study the work of other medical administrators for contrast— 
phyBlclans In public health, hospital administration, etc. 

3. Design and Implement a specific independent study on an issue In 
health care management at the HMO, Ixanples arei an analysis of 
physician productivity, long-term care planning, hospital admission 
and length-of-stay controls, etc. 

Preliminary discussions suggest that a small nraber of students would bm 
lost interested In a prograa of this nature and. would elect the preceptorshlp. 
It Is planned to introduce this program in 1976 (fall) or 1977 (spring). 
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Chapter 7 
MRV^ MEDICAL SCHOOL 
and 

HARVARD COMMUNITY mMJIB PLAN - C^RIDGE CENTER (HCHF-CC) 

The Harvard curriculum ±e the only one in this report dealing delu- 
sively with residents and the only one focused on clinical skills* The 
Harvard group developed an objective-^oriented clinical curriculmfl and fiald^ 
tested it at the Harvard Coranunity Health Plan - Cambridge Center on internal 
medicine residents participating in the Harvard Primary Care Prograa, 
The curriculum focused on areas other than Internal medicines with a 
special emphasis on psychiatry, A preliminary cost analysis of the HMO-based 
residency training was also prepared. The project was performed by staff 
physicians from the Cambridge Center and its affiliated conraunity hospitals s 
A group of three internists was responsible for curriculum development in 
all areas except psychiatry and a group of three psychiatrists (known as 
the Behavioral Sciences Subcommittee) was responsible for the psychiatric 
component and for planning for a psychiatric residency training program. 

BACKGROUND 

- - ^ 

The Harvard Medical School and its affiliated hospitals have been 

engaged in primary care education since the mid-sixties when a Family 

Health Program was initiated at Children's Hospital Medical Center, In the 

late stxtiei an occasional resident in medicine or pediatrics elected 

rotations In neighborhood health centers or other ambulatory facilities* 

Other primary care education efforti involved the Harvard Community Health 

Plan (HCHP) , as Indicated below. 
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The Harvard Cormunity Health Plan - Cambridge Center (HCHP-CC) Is the 
Cambridge satellite of the Harvard Community Health Plan^ the major center 
of which is located at Kenmore. The Cambridge Center has been in operation 
since 1973 and presently serves over 15,000 enrollees in a nm 44s000 square 
foot facility. The Kenmore Centers which has been in operation since 1969j 
has already reached capacity at over 35^000 enrollees. 

Residency training at Keiunore dates back to 1970^1971 when three 
residents in Internal Medicine and one in Psychiatry spent one afternoon 
per week under the supervision of a staff physicians Educational opportunities 
were also offered to medical students. A one-month elective provided 
several clinical students an opportunity to study In depth a problem in 
primary health carep and a course entitled The Delivery of Medical Care 
In the 1970 's* Issues and EKamples , was offered to first year students. 

Residency training was an explicit goal of the Cambridge Center even 
prior to its inception. A Robert Wood Johnson Foundation awai^d to the 
Cambridge Center in December 1972 was contingent upon the development of a 
residency training program. In July 1975 four residents in Internal Medicine 
participating in the Harvard Primary Care Program began their training at 
the Cambridge Center. The Harvard Primary Care ft'ogramj also supported 
by the Robert Wood Johnson Foundation^ supports primary care training at 
various ambulatory care sites In the Boston area for 25 Internal Medicine 
res Idents , 
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Tp CURRICULUM DEVEIX)PMENT PROCESS 

The major objective of the project was to prepare a curriculum for the 
new realdents baiad on task analysis and definition of behavioral objectives ? 
and focused on areas other than internal medicine (AOTIM) , Traditionally, -/-X 
clinical teaching has been haphazard. Learning objectives are rarely / 
specified and when they are, they are too vague to benefit either the. 
preceptor or resident. Moreover^ the skills that the resident acquires in 
his training do not always reflect the requirements of private practice and 
primary care. This approach was designed. to avoid these pitfalls * 

Drawing upon their mn eKperience In the AOTIW specialty under consideratlc 
the internists prepared a preliminary list of tasks moat often enQOuntered 
in primary care practice* On the basis of these tasks, the group dallneated 
and prograssively refined a set of behavioral objactlvesj expressed in 
terma that can be measured and evaluated. The objective list was then 
submitted to a consultant who was asked to consider: (1) what were the most 
common rfeferrali from primary care physicians | and (2) which of these could 
be treated by the referring physician? Generally, for each specialty, 
objectives were grouped as follows* 

1. Statements of history- taking and physical eKamination skills. 

2. Statements of psycho-motor skills, 

3. Inductlva (symptom oriented) considerations. 
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4, Deductive (disease oriented) considerations, 

5* Conditions and diseases that the resident must reeogni^e and 
refer for treatment* 

6. Statements of toportant t^ierapeutic principles. 

The rationale for this structure was based on convletlons about the 

general substauce of post graduate training programs , best expressed 

In the authors ' own words i 1 

1* Skills in history taking and physical eKaflination are emphasised 
as crucial areas « Too often organised formal training In physical 
diagnosis stops; after the medical student level. Areas such as 
the pelvic or neurologic examinations may not be well developed 
in the house officer who then tends to ignore these Jjiportant areas. 
Alternately I the physician in training may have mlslearned whole 
parts of the physical eKamination, We seek to emphasise fundamental 
competence in the primary care physician both in general medicine 
as well as in AOTDI (area other than internal medicine) * 

2* Within each area described below j we have identified key skills that 
belong in the primary physician's repertoire. Some of these abilities 
should be part of any doctors' capabilities i as e.g. skills in first 
aid or cardiopulmonary resuscitation* Howeverp in ttjls report we 
have focused on those skills In the AOTM that would be commonly 
used by the physician* The items listed have been cross-^ehecked with 
consultants in each area as being in the primary care realm and 
within the scope of primary physicians' practice. 

3. From the very beginning of our curriculum deliberation ^ we grappled 
with the question of using an inductive versus deductive approach. 
Most teKtbooks of medicine- utilise the latter perspective and are 
written — as MacBryde put it " . .as though every sick person 
carried his presumptive diagnosis labeled on his chest". ^ 



iMatthew A. Budd et» al.j Training Adult PrJjtiary Care Residents 
in an IMOi in Fulfillment of a Grant from the A^C* December 1975.' 

^Cyril MacBryde, ed.^ SlRns and S^^ptoms t 4th editions j.P* Lipplncott Co.» 
Philadelphia, c. 1964. 
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On the other hand, a symptom oriented mphasis more nearly reflects 
the manner in which patients present. There is a practical Itoit 
however to the mount of useful Information that can be subsumed 
under any given symptom or sign. Never thelese, the formula which 
sayss e.g.t "aCven a patient with a chief complaJjat of dlszineBSi 
proceed in the following wayu * offers a clinically uaeful 
guide* It gives fora to what otherwise may be disjoined facts not 
easily used In patient care. Within each AOTBl objectives are 
contained the major s^ptoms (or signs) that, the prtoary care 
physician can eKpect to encounter in practice. The objectives 
are Intended to reflect subsequent approaches attendant upon the 
given symptom or sign. • 

4. There comes a point in the diagnostic process where inductive 
reasoning generates a tentative diagnosis. ThuSs a taiowledge of 
specific disease states is a very important part of the physlciana' 
cognitive skills. The AOTIM curriculum objectives have listed the 
common entities with which the physician must be conversant* With 
the help of our AOTDi consultants^ we have defined these coBmion 
diseases and have classified thm. generally into two groups i 

(1) those which the primary care physician should be able to*^"'^ 
recognize and treaty and (2) those which the primary care physician 
should recognize and refer. 

5. Of the AOTBI diseases, we have chosen to segregate those Illnesses 
which though unconmon must be recognized or suspected even if 
treatment of the Illness falls outside the primary care physicians' 
capabilities. The common denominator is the treatabtHty of these 
conditions s which if missed generally have serious to catastrophic 
consequences. This characteristic justifies the incorporation of 
these problems into a separate set of objectives. Some eKamples of 
these conditions would be ectopic pregnancy, acute epiglotitlSs 
angioneurotic edema i acute disc herniation with sphincter compromise , 
and acute glaucoma , 

6. Treatment issues are a fairly obvious part of any clinically oriented 
curriculum. These objectives span the range of specific motor skills 
(e.g. using a cock up splint) to items dealing with medication 
(cost/effective objectivesi generic/brand Issues, etc.). 

The result of this process was the preparation of a set of preltalnary 
lists of objectives in eight areasi urology, ENT| ophthalmology i ortho-- 
paedics, general surgery, nutrition, dermatology and Ob/Gyn, They are 
presented in their entirety In Research Paper No. 6 , 
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Tm WISIDENCY TRAmmO PROGMM 

The prograni was pradlcated on several aisumptlons. First, the prtraary 
care physician should be able to handle the majority of problems brought 
By his panel ©f patients. Sinee these are. often In araae other than 
internal medicine^ the reildents' training raust be broadened aocordingly. 
Second, the curriculum must reflect the fact that a high proportion of 
patient visits concern psychological problemB* Thirds continuity of 
care must be an integral part of the curriculuni* Finallyj the curriculum 
itself is a dynamic product, constantly changing as results are evaluated 
and conditions change ^ 

Curriculum implementation began An July 1975 with the introduction to 
the Cambridge center of four internal medicine residents two junior 
residents from Mount Auburn Hospital and two senior residents from 
Cambridge Hospital who are participatirig in a two year residency program 
in adult primary care. The program consists of eight alternating three- 
month blocks s half of which are spent in the ambulatory care setting, and 
half at the backup hospital* Residents are paired to facilitate coverage 
of each other's patients* The content of the hospital rotation is similar 
to hospital training received by other hospital-based residents in straight 
internal medicine, except that during the hospital rotation, one afternoon 
per week Is spent at the Cambridge center. 
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During his/her stay at the Cambridge center^ the reaident is assigned 
four one-half days per week to a team consisting of an intern is t^preceptor 
and a nurse practitioner * 

The resident spends an equal amount of time per week with various 
consultants, mostly in surgery and surgical subspecialties. Both the 
consultants and the resident are provided with the appropriate list of 
objectives* It helps the specialist know what to teach and the resident 
what is expected of him. The program includes a didactic lecture once 
a week in which conaultanus discuss a topic drawn from the behavioral 
objectives p In addition, all internists and residents attend once a 
week an "Dffl Journal Club" in which participants select a topic of interest 
based on commonly occurring problems* 

THE BEHAVIORAL SCIENCE COMPONENT 

The behavioral science group tos assigned the responsibility to 
design the psychiatric component of the curriculum for the internal 
medicine residency program and prepare initial plans for a psychiatric 
residency* Utilising the procedures of their colleagues in Internal 
medicine j the psychiatrists tried but soon abandoned efforts to derive 
detailed objectives from corresponding task lists* There were several 
reasons for this* First » the data base in psychiatry is much softer than 
in the medical disciplines. Secondly, techniques In psychiatry are^ more 
related to process than tasks. Finally, evaluation of change is much 
more subjective In this field. Instead, the group developed a set of 
three overall objectives as a general frmework for the psychiatric content 
of the primary care curriculum. These overall objectives ares 
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(1) Sensitivity skills ^ learn to be more sensitive to patients 
and their needs for treatment and understanding. 

(2) Therapeutic skills ^ learn how to counsel various kinds of 
patients with problems corapllcattog, causing, or resulting 
from their medical (and social^psychological) conditions - 

(3) Referral skills - learn to recognize serious psychiatric 
disorders and develop skills of referral, utilizing 
appropriate resources, 

A further elaboration of these objectives is presented in Table 1 on the 
following page. 

A variety of Instructional methods were developed for Implementing 
this curriculum (see Table 2) , These included a one-hour didactic seminar 
per week (see Table 3); a supervisory experience where the resident sees 
one case per week; one hour per week of consultation where the resident 
observeb the psychiatrist with his p.vtients; video tapes; group experience 
with peers and faculty for a one and one-^half hour session per week; and 
electiveB as available* To evaluate the efficacy of the curriculim, the 
group developed a set of evaluation instruments s presented as Appendices 
9 and IQ , 

PI^S FOR A PSYCHIATRIC RESIDENCY 

The development of a prtaary care residency with significant behavioral 
science content, provides a vehicle for the training of psychiatry residents 
at the interface of medicine and psychiatry* A preliminary set of objectlvee 
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genavioEgi mm% coinponenc 
Obilctivii and Methods 



^aTEGQRYtF SnM' OVERAll OBJECTIVES 



SENSITIVITY SKILLS 



To educate primary cire 
pliysiciaris to be mori 
sensitive to patiinta 
and their needs for 
treatinent and underEtandinj 



Understand the proeesi of nomial 
divilopnient through lifi cyeli. 

Be aware of own reactions and effact 
of treatniint process, 

Undiritand iconanics class and 
environmental influences on illnaaSi 

Learn to use knowledge of psychosocial 
facton and community risources for 
triatniint, 



•HETHODS™™ ' 



Didactic s Supervision, 
Consultation. 

Groupj Consultationj 
Supirvision, 

Didactic, Coniultation 



)idactic, Consultation 



THERAPELiTIC SKILLS 



REFERRAL SKILLS 



giERiC 



Learri how to counsel 
various kinds of patiints 
with problems complicating, 
caiising or riiiilting from 
their .iTiidical (and psycho- 
social Gonditioni,) 



Werstand the ''psychosomatic approach" 
in its broadest sense, 

Be experienced in rudinents of history 
takingj interviiwing skills , and minor 
psychotherapeutic techniques. 

Be able to recognizi and deal with the 
acute (though often low level) anxie^ 
and depregsion often related to illness. 



iactici Coniultation 



DidactlC; Supervisionj 
Consiitation, Videotape 



Didactic, Supervisionj 
Consiitation 



Learn to recQgniM serious 
psychiatric disorders and 
develop skills of 
referral process, utilizing 
appropriate resources. 



Devilop diagnostic skill for major 
psychiatric disorders, 

Be able to elicit data relevant to 
suicidal or homicidal potential, 

Ifeow how to arrange for hospitalization 
when needed, 

Know how to work with psychiatrists in 
presiding proper triatment, 

Understand various types of paychia trie 
treatiiiintj other typis of therapists, 
and ways in specialiied sirvicii are 
prasintei, 



Didactic, Consultation 



Didactic, Consultation 
Videotape, 



Didj 



DidactiCj Group, Supervisi 



Didactic, Bupirvision 
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.... ..... ^^^^^^^.^ 

nEHAVIORAL SCIENCE COMPONENT 
TEACHING METHODS 



Didactic Seminars (D/S) 

A series of one--liour presentations intersperaed throughout the year with 
other medical topics. Designed to provide practical and applicable 
pBychosocial infoCTiation relevant to the phyiiclan's daily clinical case load* 

Superviaory Ebcperience (B) 

Specifically designed to offer the resident closely monitored experience 
in dealing with the emotional problems of medical practice. Residents ' 
will see patients in brief' psychotherapy to learn how to deal with 
appropriate cases in individual or couples therapy. Each resident will 
see one case per week. 

Consultation (C) 

Each resident should learn how to utilize the services of a psychJatric 
consultant in the management of his usual medical case load* Psychiatrists 
can observe the resident's interviewing and hi story- taking technique^ how 
he establishes a doctor-patient relationship (alliance) 3 and how he attende 
to cues in his decision--making process. Regularly scheduled medical patients 
will be seen by the psychiatrist and resident. One hour each week. 

Videotape (V) 

Useful for observing how experienced interviewers talk to patients as 
well as for observing oneself critically in the process of learning and 
using new skills. 

Group Experience (C) 

Designed to foster interaction of peers and faculty in one-and-one-half 
hour sessions each week throughout the two year program* Case-^ oriented 
discussions are co-led by a psychiatrist and primary care preceptor and 
will include comments on and criticism of the resident's understanding 
and skill. Part of the experience will have as its objective to learn 
about oneself' — ^reactions to patients^ prejudices^ strengths and weaknesses^ 
the interaction of physician's personality with that of the patient. The 
emphasis is upon the experiential (rather than substantive) side of beccffling 
a doctor and engaging in doctoring, 

tlectives (E) 

Residents with special interests will have opportunities in the second 
year to pursue these (e,g, applications of hi^nosis to medical carej 
behavioral techniques, etc). 
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' TABLETS— ~ 
BBIIAVIORAL SCUlNCi; COMPONENT 
DIDACTIC Si:SSIDNS 



For the primLiry care physician to be able to care for his patients as a 
whole, he/she must be able to acquire the knowledge and experience which will 
permit him/her to compose diagnoses and treatment plans in physical^ psycho^ 
logical and social terms, A series of semlnarSj interspersed with other 
medical topics throughout the year is ini ended to complement other learning 
experiences with attention to practical application to office practice- 

1. The tlmotional Aspects of COTimon r^oljlems l^esenting to a Doctor i A Survey 
of Medical Practice* 

Wliy do patients come to the doctor? Wliat do they want? Tuning your 
ear to the chief complaint. 

2. ITie "Psychosomatic " Approach: Illness as a Unified Whole, 

Tlie fallacy of mind-body ^ organic^ functional dualism, 

3. The F^perience of Illness i What It Means to be Sick, 

Determinants of paini cultural and social aspects. 

4. Hypochondriasis I Isn't All Pain Real? 

5. The Life Cycle and the tamily: A Developmental Approach to the Individual 
Problems Related to Phases of Growth, Adolescence^ Mid-life^ Old Age, 
Death and D^ing. 

6. Eliciting the Sexual History i An Approach to Individual and Marital 
Sexual Development. 

7* ^Miad reelings'M Hecogni'/iing and Nkmaglng Depression and ArDciety* 

8. Suicides How to Assess the Risk find Wliat to Do'. 

9. Habit Patterns and How to Modify Them^ 

Uses of Hypnosis 5 TM^ Group Therapy, Biofeedback 
Tlie Ffealth Hti^^ards of Smoking, Obesity 5 T^ug Abuse 
Alcoholism and its Ntedical Treatment 

10* PsychopharTnacology : \Vhat teugs for What Problems? 

11. Practical Tips on Interviewing, Takin^^ a Niental Status^ and Making 
Personality Diagnoses, 

12; The Physician as Psychotherapist- Brief Techniques* 

13. Referral to a Psyehiatrist : When, Why, and How? 

14. Community Rtisoiirces and Other Therapies, 
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of such an experience are presented as Table 4 on the following page. A 
proposal for a psychiatric residency program is presently being negotiated 
with McLean and Cambridge Hospitals - 

COST MMJYBIS 

Robert Lawrence, M.D.j a member of the Internist group and director 
of the Harvard Prtoary Care Frogram, prepared a preliminary cost analysis 
of the internal medicine residency training program at the Cambridge 
Center. He found that the average resident produces 7.1 patient visits 
per four-hour session compared to 13,0 patient visits for the average 
internist. However, the resident doesn't quite pay his way. While his 
stipend averages $12,000 per year, the replacement value of his production 
is about $9i900 per year for a net cost of about $2,100, However, this 
figure does not Include productivity loss of the preceptor resulting from 
time devoted to teaching* 

The cost analysis is presented as Resource Paper No. 16 , Both the 
methodology and the figures are preliminary in nature and need further 
refinement, especially with regard to staff productivity loss. 
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TABLE 4 

PSYCHiATRIC RESIDENCY OBJECTIVES 



A residency track in psychiatry and primary medical care should 
address itself to the following objectives i 

1. Acquaint the resident with the body of taiowledge which comprises 
psychosomatic medicine as a acientific discipline. 

2. Teach the resident the skills necessary to apply a psychosomatic 
approach to all of medicine. 

3* Provide an experience which includes close working relationships 

with non-'psychiatrlsts as well as paraprof easionals • what will be 
an interdisciplinary approach. 

4. Obtain experience in a general hospital or ambulatory setting, to 

familiarize oneself with the spectrim of patients who are treated for 
acute illness by the medical profession* 

5* Work closely with a primary care physician in a typical (or simulated) 
office practice for maximum exchange of viewpoints, styles, and skills, 

6, Obtain special training in behavioral modification techniques , hypnosis 
and other modalities which rely to some extent upon an appreciation 
of psychological understanding in their application to general 
medical complaints (e.g. obesity, smoking, accident pronenessj gen^ 
eralized anxiety, and so on*) 

7t Devise and carry out a circumscribed clinical/research project which 

demonstrates the use of the psychosomatic approach and its applicability 
(by the primary care physician) to general medicine* 

8. Learn and appreciate the nature of primary medical practice, including 
the pressures, orientation, skills, styles, rhythm, and so on of the 
primary physician* 

9. Learn how to translate psychodynamic principles Into comprehensible 
language with practical application to the common problems of medical 
practice, 

10* Learn how to alter the psychiatric stance and interviewing style of 
the psychiatric Intake process to the more medically-oriented model 
of the practicing physician. 

11, Le^ i to recognize and deal with one-s own discomforts about "return^" 
.ing" to the medical scene, often experienced as a regreasion in the 
psychiatrist's identity as a psychotherapist and specialty consultant* 

12. Learn how to be supportive and not critical of the physician who is 
ftylng to learn how to cope with his own anxieties, especially around 
the aspect of converting from an active to a more passive listening 
approach. The psychiatrist must refrain from "psycho-^analyslng" his 

* primary care colleague* 



APraiNDDC 9 

3EHAVI0R SCIENCE COMPONENT 
SAMPIE PRE /POST TEST 



The important advantages of opet^ended initial questions in an interview are: 

a* It provides rapid access to the quality of the patient's speech and 

his major concems, 
b. It improves the effipiency of the interview, 

c* It provides an opportunity for the interviewer to preient himielf as 

a sympathetic listener* 
d. It allows the interviewer to avoid sounding judgemental. 

In the previous and subsequent questionSj answri 

l^if a and c are correct 
^ 2-if ajb^and c are correct 

3- -if b and d are correct 

4- if only d is correct 

5- if all are correct 

Currently available biofeedback techniques offer useftil therapy fori 

a. Ulcerative colitis 

b, Raynaud's PhenOTienon 

c , Aithma 

d. Migraine headaches 

In one paragraph^ define and explain the use of the word ^'psychosomatic^-* 

Match one or more entries in column A with those in column B 

A 13 

A, Psychophysiological Disorder 1* 

2* 

Conversion Disorder 3, 

4. 

C* F^pochondriasis 

D* Malingering 6, 

7. 
8. 
9, 

10. 
11. 
12, 
13, 
14, 

IS, 



^fianchausen ' s syndraTie* 
''La Belle Indifference'* 
Autonomic nervous system 
Inappropriate preoccupation with pathology 
of bodily itinction 
Symbolic meaning to the sjmiptora 
Self-inflicted injury 
Volimtary nervous system 
Primary anatomic alterations 
Functions as a defense against painful 
feelings, 
Voniting 
False pregnancy 
M-graine headaches 
Physiological fluctuations 
Associated with increased suicide 

risk when the patient is depressed * 
Responds to psychotherapy. 
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Append Ik 9 (continued) 



5. A 30 year old singlG registered nurse preaenlb with Simiptoms of tension, 
trembling j and apprehension. She reports tliat 1-2 months before she had 
terminated a relationship with an older^ married physician on the staff of 
the hospital at which she works ^ whari she continues to see on a regular 
basis at her work. She weighs 220 pounds and admits to chronic obesity 
since age IS, despite many efforts to lose weight. Reasonable explanations 
for her presenting complaints Includes- 

a- Caffeinism secondary to Intake of greater than 20 cups of coffee per day. 

b . Hyperthyrold ism . 

c. Cturonlc amphetamine and/or diet pill abuse, 

d . Pheochromocytoma . 

Answer as in Numbers 1 and 2. 

6. A Regitine challenge test done in your office is negative. She denies 
smoking, consumption of caffelnated drinks and/ or use of any drugs. 
Inquiry into her feelings about her fomer paramour are fruitless ^ since 
thougii her eyes brim with tears, she insists she no longer has any emotions 
about the relationship. instead^ she asks for a prescription for "medication 
to help mi through the next couple of weeks llie time for her appointment 
is already over and your phone rings indicating that your next patient is 
ready to be seen. ITie most appropriate measure to take at this point is: 

a. Immediately write a prescription for Valium^ #25 ^ 5 mg po tid. 

b. Write a consult form to ^fental Itealth. 

c. Arrange to see the patient within a week or two to collect ftirther history. 

d. Take another half hour to collect more data about her relationship mth 
the doctor before coming to a decision. 

(choose the best answer) 

7. Ifearlng that lier request for medication has been at least temporarily refusedj 
the patient angrily replies that you don't understand her problems and 
aren't really interested in helping people. She says she sees no point 

in retuiTiing to see you under these conditions. To then wite a prescription 
for Valium would then: 

a. Touch her, and cement the therapeutic alliance. 

b. Be providing the apprdpriate drug anyway. 

c. Reinforce maladaptive behavior. 

d. Reinforce healthy assertiveness, 

8. Other effective and appropriate treatments for amciety Include ^ 

a. Assertion therapy. 

b. Transcendtal Meditation, 

c. Autohypnosis. 

d. Reassurance that there is no cause for anxiety. 
(Answer as in Numbers 1 and 2) 

9. The usual minimum daily therapeutic daily dose of tricyclic. antidepressants 
for treatment of appropriate depressions in a 140 pound wanan under age 60 isf 

a. SO mg 
t), 100 mg. 

ISO mg 
d, 200 mg 
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Append Ik 9 (continued) 



10. The most uselul service provided by a priniaiy crire pliysician talking with 
a teiirFul, unhappy patient is! 

a» Supplying the kleenex. 
Reassurance 

c. Sympathetic interest, 

d. Reminding the patient there are others worse off than he is, 
(Choose best answer 

11. Match one or more treatment modalities frm column A with entries flfom 
column B, 



A ^ B 

A, Tricyclic antidepressants 1. 47 year old businessman with early 

morning awakenings weight losSj and 
Counseling by Primary Care anorexia who feels worse in the A,M, ^ 

Physician. • and whose father had severe depressions 

culminating in suicide, 

C. Referral to Psychiatrist 

2. 23 year old single female ^ with 

D. No medications tearftil depression around breakup firom 

boyfriendj who is maintaining work 
NAO Inhibitors function and who describes auctiations 

between tearftilness and cheerfulness* 



3. 33 year old woman who says she has 
^^never been happy ^% complains of 
chronic mistreatment at the hands of 
others 5 who is currently sleeping and 
eating more, 

12, A 45 year old woman ftrom a "good ramlly^^ gives a history of ehronlc flank 
pain and reports passing stones on at least one occasibn. She relates to 
you in a dependent, compliant manner. You send her to the WC to provide 
a urine specimen and by accident your nurse associate bursts in on her 
dipping a bleeding finger into her urine cup. Outraged by this deceitj 
you are about to order her out of your WC and consulting room when you 
decide instead to talk with her. The best approach would be* 



a. A scathing denunciation of her attempt to make a fool of you, 

b, A cool, firm confrontation, expressing your angerj in hopes of 
extinguishing her manipulative behavior through punishment, 

c, llxpression of sui^risej even irritation, alo.ig with a wish to 
understand why she needed to tamper with her urine sample. 

d. Ifaving your nurse talk with her while you cool off. 
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Appendix 9 (contiriued) 



SUICIDE 

1* Suicide is more common among i (circle one of each pairl 

a. men-women 

b. youngs old 

c. blackB-whites 

d. married-divorced 
married without children-married with children 

f\ Proteitants-Jews 

g. rural dwellers-Durban dwellers 

h* 'in the spring=in the winter 

i. patients who have attdmpted suicide before-patients who have never tried be for 

2. Suicide is a more frequent cause of death than: True false 

a. Coronary heart disease 

b. Leukemia - -- 

c. Homicide -.-^---^ 

d. Tuberculosis 

e. Cancer ' =^ 



Concerns over suicide increase as patients become more depressed. Which of 
the bodily symptoms listed below would Increase yoi^ concern about the 
seriousness of the patient's depression: (circle all appropriate answers)* 



a. 


Productive cough 




b. 


loss of appetite 




c* 


loss of weight 




d. 


sweating 




e. 


waking early in the 


morning 


f. 


palpitations 




h. 


loss of interest in 


and desire for sex 


i. 


constipation 





A fifty*seven year old man is seen for evaluation because of weight loss of 
20 lbs* over the last three months. He confides in you considerable disap- 
pointTnent over the promotion of a younger employee to a supervisory position 
he assumed he would be asked to fill. In additionj he expressed his resentment 
over infrequent invitations to his three childrens' homes in the 15 months 
since his wife died of cancer. He acknowledges feeling quite depressed and 
despondent about his future, Yofi need to assess his potential for suicidal 
behavior. t 



True False 



a* Asking directly about thoughts of suicide will put the 

idea in his mind* 
b* Questions about plans for suicide such as dete^ place^ 

methods allow you to assess the degree of preparedness 

to die. 

c- You call his daughter who tells you not to wori^ 
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(continued) 



True 



False 



d. Painful feelings of worthlessness and hopelessness 
can be alleviated by letting the patient know that 
these are all part of getting older and having sad 
things happen* 

e* Your concern is increased by his lack of peiTnission 
to cry combined with his guilt about enjoying 
pleasures since his wife died. 

f* The patient requests for pills to give him some strength 
to go on allows his interest in the future, 

g. The patient request for liospitallzation should be 
discouraged as it will only foster his hiding Irom 
reality and delay his adjusting to his losses* 



A 27 year old man presents asking for evaluation of a swolleri wrist. Your 
history reveals that he and his wife have been fighting about his mother's 
criticism of her housework and childrearing practices* In the midst of their 
last argument he felt like strangling his wifej became frightened of his 
rage 5 and suddenly turned and slammed the wall with his fist* Which of the 
following would increase your concern about violent or murderous behavior? 
f Circle all appropriate items) ! % 

a. Use of alcohol* 

b. Use of amphetamines* 

c* Smoking over 1 pack per day. 

d. Brutal beatings as a child, i 

e. History of torturing animals* * 

f. lineuresis^ history of' 

g. Diarrhea* 

h. Owns a gun* 

i. FJxperience wil:h weapons in armed services or sports club, 
j* Past arrests lor assault. 

k* Sei^^ure disorder. 

1* Diabetes* 

m* Loner. 

n* Suspiciousness or paranoid psychosis* 

o* Homosexuality. 

p* Preoccupation with revenge and retaliation* 

q. History of fire setting, 

r. Hyperventilation syndrOTie. 

s* Sense of powerlessness to change painful realities f 

t* Sense, of acute humiliation. 



lOMICTDf: 
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APPENDIX^ 10 = 

MTiNO scale; 



In an attempt to evaluate and monitor the personal and emotional skills ^ 
development, and deficits of the primary care internal medicine residents ^ 
the following assespment form was developed* The psychiatric preceptor 
completes this assessment at the beginning and end of the training period. 
We are considering as well its use nl more frequent intervnls. The data 
is collected with the preceptor observing the resident as he or she conducts 
a complete history and physical examination* Additional data is dravm 
upon during the trnining period from their weekly sessions (see teaching 
methods). It is our hope that such an instrument periodically completed 
will help the preceptor discriminate areas of strength and weakness in 
the resident's development and that both constructive feedback aid re- 
shaping of the subsequent training experiences can be considered, ITie 
use of both a narrative and visual recording of data helps in monitoring 
progress 5 collecting impressions ^ and avoids losing sight of problem 



areas in a resident's generally satisfactory performance, 

BEHAVIORAL ASSESSMENT I;QRM (adapted ftom Personality Patterns of Psychiatrists 5 
" by R,R, Holt and Luborskyj Basic BookSj 1958 

Name: 
Age: 
Sex: 
Race: 

Marital Status and years: 

Children - age and sex: 

Religion: 

Year of Training: 

Past training in interview skills and psychological issues 1 



Past personal psychotherapy- 
Intelligence : high 



average 



below average 



Appendix 10 (continued) 



Circle the best approximate description and comment i 

I. While taking a medical history and doing a phyiical examinations 

A. Shows respect for and appreciation of the meaning of the symptoms 
or illness to the patient 

a* demonstrated 
b, variable 
Cp limited 

B, Takes a psychological history 

a , thorough 

b, superficial 

c , avoided 

While taking a psychological history 

ru is comfortable 

b* is moderately uncomfortable 

c, is quite anxious 

Makes a personality assessment when with a patient 

a, regularly 

b, has some sense of patient -s personality style 

c, fails to make assessment 

l^. Uses personality assessment of pntient in dealing with the patient 

a. regularly 

b. occasionally 

c. inrrequently 

W Does a respectful physical examination, understanding issues of 
modesty, deformity ^ agings puberty ^ exhibitionism 

a* sense as present 

b* variable 

c. absent or limited 



II. Shows an Interest in his/her patient and is warm and empathlc 

a* demonstrated 
b, variable 
c* limited 

III, Sensitive to patient cues and needs 

a* demonstrated 

b. variable 

c. limited 
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Appendix 10 (continued) 



Tolerates stress In the doctor-patieTit relationship from patients. 
A, Anxiety 

a, demonstrated 

b, variable 

c, limited 

D. Anger 

a. demonstrated 

b. variable 

c. limited 

Seduclivcness 

a. demonstrated 

b. variable 

c. limited 

D. Sadness 5 grief or depression 

a, demonstrated 

b, variable 

c, limited 

E. Threats 

a. demonstrated 

b* variable 
c. limited 

f- Criticism 

a, demonstrated 

b. variable 
limited 

G, (Chronic, refractory 3 terminal illness 

a. demonstrated 

b. variable 

c. limited 

H. Distress , over uncertainty in diagnosis or outcOTe 

a* demonstrated 
b* variable 
c. limited 



97 



Appendix 10 (continued) 



V. Inspires confidence and trust 

a . regularly 

b . variable 

c . rarely 

VI, Accepts responsibility., 

a* easily 

b* fairly well 

c. poorly avoids it 

VII. Impulsive - Judicious 

a* thought ftil and careful 
b, variable 
c* impulsive 

VIII, Firmness 



a, firm 

b, vasclllates 
c* passive 

IX, Seductiveness with patients 

a. Under control 
b* variable 

c, is seductive with patients 
X, Hostility with patients 

a* under control 

b, variable 

c* expressed loses control 
XI* Tolerates heavy work load 

a , well 

b, variable 

c, poorly* complainsg gets disorganizedp irritablej scaredj depressed. 
XII, , rinds pleasure and satisfaction in the work* 

a. regularly 

b. occasionally 
c* rarely 

XIII, Can say ^-no" to patients 

a, ^easily 

b, with discomfort 

c, area of trouble for resident 
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Append Ik 10 (continued) 



XIV, Interested in patient as a person as well as an illness/symptom 

a. Interested in the person shown 

b. variable 

c. interest primarily in the illness/symptom 
XV. Skills in synthesizing data 

a. good 

b. variable 

c. limited 

XVI, flexibility with patients 

a. tlexible - can share controls with patient 
h. variable 

rigid and domineering with patient 

XVII, Sen^e of humor with patients 

a . good 

b. fair 

c. limited 

XVIIL Tact 

a . tact ful 

b. variable 

c. tactless 

XIX, Insight into own personality 
a* good 

b. variable r 

c. limited 

XX, Tolerant of others 

a. consistently 

b. variable 

c. intolerant 

XXI, CommuTiicates effectively with patients so they understmd material presentee 
and can hear it 

a. consistently 

b. variable 

c . rarely 

XXII. Communicates effectively with staFf so they understand material presented 
and can hear it 

a, consistently 

b, variable 

c, rarely 
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XXI IT, Considers social class, ethnic ^ religious values as they affect patient 
and illness, 

a > regularly 

b, variable 

c . rarely 

XXIV, Curious and eager to learn 

a. very 

b. variable 

c. limited 

XXV, Sense of ethics 

a. high, concerned 

b. variable 

c. lack of concern 
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Chapter 8 
FINDINGS AND REC0!^NDATI0NS 

It is evident from tlie previous chapters that this project accomplished 
much more than it set out to do. While the original objective was to develop 
educational program in HMO's, much more was achieved, including the 
following^ 

- the implementation am well as development of educational programs 
in HMOs, 

- the development and i^lementatlon of evaluation methodoiogies and 
related instruments* 

- the development and pilots-testing of a cost methodolo^ for measuring 
educational costs in the HMO. 

- the development and impleTOntation of a preceptor training program. 

- the development of HMO-based educational programs for different levels 
of medical education, including preclinical, clinical, and graduate 
medical education* 

The collaboration among the participating institutions made possible through 
the three conferences that were held during the course of the project, provided 
each institution the opportunity to specialize in an area of its choosing to 
match its interests and skills. Table 8-1 below lists the areas of speciallza-- 
tlon for each institution* 
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Table 8-1 

SUMMARY OF ACCOOTLlSHtENTS BY INSTITUTION 



Area of Spacialization 


GU 


TO 


UP 


uw 


BROWN 


HARVARD U* 


1* Curriculum Devalopment 
Process 


YES 




YES 






YES 


2, Curriculum Content 


YES 


YES 


YES 


YES 


YES 


YES 


3. Instructional Methoda 


YES 


YES 






YES 




4. Program Evaluation 




YES 


YES 


YES 






5* Educational Costs 




YES 




YES 




YES 



As indlcatad in the Tables thraa institutions spent a consldarabla amoimt 

of tima in desiring a curriculum development process. Curriculum content was 

emphasized by all institutions while three institutions concentrated on instruct 

tlonal methods* Three institutions developed evaluation TOthodologies and 

related ins truments, while raother group of three inatitutiona present data on 

the coat of teaching in an HMO, The remainder of this chapter discusies these 

acco^llshmenta in detail and presents our findings, concliiaions and racoiMaendations, 



102 



^EDICAL EDUCATION IN THE HMO i WHAT'S IN IT FOR THE JffiDIGAL SCHOOL? 

Why should a i^dical school get involved In teaching in the' HMO setting? 
Teaching in the HMO presents a number of difficulties as well as definite 
advantages- The HMO la a service^ not an educational institution. Given the 
strict cost accounting of today's HMOs ^ the Introduction of an educational 
program might be a costly proposition. Moreover, the nuiriber of students 
that m HMO can acconimodate is strictly limited by service obligations, 
availability of space and the willingness of clinicians to teach. From the 
medical school's viewpoint, what are son^ of the advantages or benefits 
derived from learning experiences in the HMO? 

Medical schools have been under increasing pressure in recent years to 
produce more primary care physicians* As they respond to the challenge, 
additional primary care training sites will be needed to accommodate the growin 
numbers of primary care physician trainees. The HMO, as a primary care train- 
ing site, presents opportunities not readily available in the traditional 
primary care training sites such as the hospital outpatient department or 
emergency room, 

1. 'nie BM offers the student a primary care role irodel not found in the 
traditional setting. 

2, Since HOT enrollees tend to represent a cross section of the commimlty, 
the student is mre likely to encounter a wide cross section of diseases 
in the HMO than in the traditional training sites* 
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3. The HMO provides the student with a unique opportunity to observe or 
learn in a setting thaf emphaaizea preventive care, quality of care, 
and coat containment, 

4. The HMO eKposes the student to an alternative health care delivery 

sys tenu 

WHAT'S IN IT FOR THE HMO? 

Why should an mO be involved in niedical education? An HMO is a service 
not an educational institution. Even if the full costs of education are paid 
by an outside agency, why should the HMO member, who pays a high premium for 
his health care, subject himself to the care of an.ams^asoned resident or 
medical student? Here, too, medical education offers a nunier of distinct 
advantages : 

1. Quality of Care - Althou^ this has not been conclusively proven, many 
believe that the Intellectual and professional etimulation involved 

in teaching tends to improve the quality of care, 

2. Recruitment of Qualified Physicians ^ Many believe that the availability 
of teaching opportunities tends to attract better qualified clinicians, 

3. Recruitmnt Costs - This is a major benefit to the ffiiO md the enrollee. 
The physician trainee is a prime candidate for a full-=tlme, permanent 
position with the HMO upon completion of his training. The savings in 
recruitment costs include not only the cost of advertising, but also 
time spent in interviewing candidates and educating the new physician to 
an alternative health care delivery mode. 
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4. Student supervision - As indicated in the following section (p. 64), 
we found that the student is closely supervised in the HMO setting, 
so that the quality of care is not lowered by the introduction of 
students, 

5. Faculty Appointments - The opportunity for faculty appointments assocl^ 
ated with a medical education program provideo an added benefit and 
Inducement to recruitment. It means that a lesser amount in salaries 
and'^fringe benefits is required to attract highly qualified physicians. 

6. Tertiary Care - The association with a nodical school not only adds 
prestige to the HMO, but also provides easier access to quality tertiary 
care in the university hospitals 

WHICH HMOs ARE BEST SUITED FOR TEACHING? 

To determine what type of HMD is best suited for teachings we examined 
selected characteristics of the tmOs participating in this project, see 
Table 8^2, below. We found thati 

One-half of the participating MOs are sponsored and operated 

by TOdical schools and the other half are independent or supported 

by other agencies; 

All but one of the MOs are relatively "yo^g"* having opened for 
services in the early 1970' s; 

With one or two exceptions ^ the HMOs have been rainarkably succass- 
ful in meeting their targeted enrollment levels; 

Three of the HMOs were utilizing their facilities to full capacity* 
The facilities at the other three HMOs were under-utilized ^ 
primarily because the HMOs were still gearing up to full enrollment. 
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Table 8-2 

CHARACTERISTICS OF ThlE PARTICIPATING HMOs 





Sponsor 


Opened for 
Services 


Number of 
Enrollees 

C1975) 


Facility 












GUCHP 

Washington, D.C* 


medical 
school 


1972 


10,000 


3 Outpatient 
Facilities 


GVGHA 

Rochester, N.Y, 


Blue Cross 


1973 


20,300 


52,000 sq.ft. 


PENN URB 

Philadelphia, Pa, 


medical 
achool 


1974 


not 
available 


5,500 aq*ft. 


GHCPS 

Seattle, Wa, 


Independent 


1949 


200,000 


9 Outpatient 
Facilities | 
300-bed hdsp 


RIGHA 

Providence, R.I. 


organized 
labor; 

Insurance Co, 


1971 


15,000 


13,000 sq.ft 


HCHP'CC 
Cambridge, Ha* 


medical 
school 


1973 


15,000 


44,000 sq.ft 
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What can we conclude from these findings? A compariaon of the group of 
HMOs sponsored by medical schools with the group of "independent" HMOs 
reveals no significant differences between the two groups regarding their 
educational accomplishments eKamlned in this chapter. In other words j the 
"independent" H^s performed just as well as the university"-sponsored ones 
in this project. This leads us to the somewhat surprising conclusion that 
the independent HMO la as well suited for medical education programs as the 
universi ty-^sponsored HMO. At least one of the three \iniversity--sponsored 
HMOs included in this project has been established primarily for the purpose 
of providing the medical school with a site for primary care educationp 
On the basis of our experience we have found no evidence to support the 
establishment of an HMO by a medical school solely for the purpose of educa-^ 
tion, Truej all but one of the participating HMOs are still in their Infancy 
it is possible, and perhaps probable, that as th^e ffilOs mature and the educa-* 
tlonal programs develops the quality of the university-sponsored curricula 
would surpass that of the "independents". But we have found no evidence to 
support this contention. In any cases in the early stages of KMC development 
there are few significant differences in the educational programs of the to^o 
groups . 

Another surprising concision is that a relatively new HMO is just as 
capable of mounting a successful program as a more stable and mature one. 
For exai^le, the Harvard Comnmlty Health Plan at Cambridge in^lemented its 
primary care residency training program exactly two years after the HMO 
became operational and GVGHA Implemented its program for first year medical 
students less than one and one-Jialf years after it opened its doors* It 
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should be noted however, that with one or two exceptions ^ the ntwer HMOs 
included in this project have had spectacular auccesB In meeting enroll- 
caant targets and developing a sound financial base* This leads us to con- 
elude that an HMO should not imdertake an educational program if it faces 
najor marketing or financial problems. 

The "younger" HMOs appear to have an added advantage of haldng adequate 
facilities for education before they reach full capacity* However ^ we found 
that the availability of space is not a major factor In deteralning the size 
or quality of an educational program in an HMO. For example, Group Health 
Cooperative of Puget Sound, the most established of the six HMOs and the 
one with the least "extra" space, has an extensive educational program. 
In addition, RIGHA made due with a tight space situation. We conclude that 
the availability of extra space is not a major advantage nor is the lack of 
it a major impediment to teaching in an HMO under present circiaQatmces of 
student assignment. Should more extensive student assignments be necessary, 
space limitation might pose a more serious problem, 

WHAT CM /SHOULD BE LEARNED IN M HMO? ( CONTENT) 

The question, "what can be most effectively and efficiently taught at 
an HMO?", was frequently raised at the conferences of participants. Although 
discussions usually revolved around three learning areas — IMO concepts j 
primary care, and clinical skills ™ these were never defined or even naMd 
aa such at the time. Table 8-^3 * below, indicates the areas the institutions 
finally chose to e^hasize under this contract. It should be noted * 
however, that raost.dLiWti tut ions included all three subject matters in their 
program but chose to emphasize one rare than another. Wxat do these learning 
areas ii^an and what are some of the advantages and limitations of teaching 
them in the HMO? 108 



TABLE 8-3 . : , . 

PRINCIPAL LEARNING OBJICTIVE OF HMO-BASED CURRICULUM .": 
m LEVEL OF JUDICAL EDUCATION MD INSTITUTION 

" ""\" ~ ■ ............ ■■•r-- 





Learning 
IMO Concepts 


Acquiring Knowledge/ 
Attitudes in 
Prlmty Care 


Acquiring 7; 
Clinical Skills . 


Georgetown 
University 


preclinical 
students 




■ ■. ' 


Univaraity of 
Rochester 


First-year 
medical students 


First-year 
mdical students 


• . , 


University of 
Pennsylvania 


- 


All Medical 
students 


Third year laedieal- 
students . 


University of 
Waehlngton 




First to Third yr. 
medical students 


First to Third yr. 
medical students 


Brown 

University 


clinical students 




- , ■ - j 


Harvard 
University 






Graduate Btudents: 



I 
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HMO Concepts - A curriculum emphasizing HMO concepts introduces the student 
to concepts related to HMOs^ such as the organization md managemnt of BHOb 
marketing, finmcing and economica, the chmging role of the provider^ and 
consumerism. The irtanual, A Student Guida to HMD's , Resource Paper No. 2^ 
is a good example of this. Teaching students about HMte offers several 
advantages* It is inexpensive, it can be done outside the HMO facility 
thereby avoiding Interference with service, it can enco^^s a large n^ber 
of students, and the bulk of the teaching can be done by non-physicians* 
As the project progressed, however. It soon became evident that teaching 
students about mCm does not fully utilize the potential of the mO, In 
facts the institutions that had originally chosen to e^hasize this content 
area have either already expanded the curriculum to include other raatertal or 
are planning to do so this year* 

Primary Care - A curriculum emphasizing primary care introduces the student 
to concepts such as team practice, continuity of care, quality of care and 
patient education through observation or practice* The HMO is well suited 
for this kind of learning since It offers "real world" primary care role 
models and a wide cross^sectlon of diseases and conditions. On the other 
hand such a program Is more costly. It requires more staff time md also a 
student presence In the HMO that can interfere with services. Three institu- 
tions emphasized prima^ care in their curriculurai but each of them, it should 
be noted, chose to concentrate in one other content area as well. 

Clinical Skills - Teaching clinical skills in the HMO Is a costly proposition 
and It raises the question of patient acceptability, always a sensitive 
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issue in an institution auch as an HMO, It requirae closer supervision and 
a large tixm comMtment on the part of the preceptor* On the other hmd, 
clinical teaching In the offers advantages over other settings. For 
one thing, we found that in general the student is closely supervised 
in the HMO setting* This Is probably due to the need to secure 
the patient *B acceptance and approval and to reassure him that he*s receiving 
proper care. In fact^ we find It pleasantly surprising that there has been 
very little resistance on the part of the patients and ¥M0 enrollees to these 
education efforts. The Group Health Cooperative of Puget Sounds which has 
the most extensive experience of any of the participating ffllO' . In clinlaali 
teaching j has studied this Issue closely and has found wide patient acceptanci 
Group Healths of course, takes elaborate precautions to ensure prior patient 
consent- 
In susraary, any of these three content areas are appropriate for teachlni 
in the HMO setting* However ^ teaching mO concepts is the least costly but 
also constitutes the least efficient use of HMO resources, while teaching of 
clinical skills Is the most costly but also most rewarding for both preceptor 
and student* 

WHEN IS HMO-BASED LEAMING MOST EFFECTIVE? 

At what level of medical education Is HMO-based learning iMSt effective? 
Should the student be introduced to the HMO during the preclinical , clinical 
or graduate years? These questions also received frequent hearlnga at the 
conferences. Inspecting Table 8-3, again, we notice that (1) HMD concepts 
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were most fraquently taught to preclinical students | (2) priBmry care was 
a subject for all medical students; and (3) clinical skills were introduced 
primarily to clinical and graduate students. 

In our site visit to GVGHA we interviewed a group of first-year students 
participating in the introductory mO course desig^ied under the auspices of this 
project* We were most impressed with the depth of toiOTledge demonstrated by 
the students. We foimd that medical students are most receptive to learming 
about the health care system at the earliest stage of their medical education* 
Soon after his first semester, the student seems to be obsessed with the need 
to learn clinical skills and his interest in learning about the health care 
system declines accordingly. Primary care Issues can and should be learned 
at all levels of Mdical education. The student should be introduced to these 
issues at the earliest opportunity through observation and/or didactic 
sessions, and^in later years, through clinical practice in the primary care 
setting. 

Teaching clinical skills in the HMO is most appropriate in the clinical 
years, preferably the fourth year, and at the graduate level. Group Health 
Cooperative of Puget Bomd is the only Institution that has eKperlmented with 
teaching clinical skills, such as history taking and physician examinations, 
in the preclinical years. This teaching was done primarily at the Group Health 
Hospital and at no cost to the HMO since the costs were absorbed by the medical 
school. Under normal circumstmcrt, however, clinical teaching in the pre- 
clinical years represents an Inefficient use of HMO resources* 
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HOW DO YOU TEACH IT? (INSTRUGTIONAL IffiTHODS) 

The participating Inititutions used a variety of teaching methods for 
getting the material across to the students, with the method depending 
largely on the content area and the level of education. For teaching H>D 
and primary care concepts to preclinical medical students, the institutions 
generally used a con^ination of didactic lectures, student --initiated 
research projects, and site ^sits to local HMO's, Clinical teaching usually 
involved observing the preceptor at work or practicing imder his supervision* : : 

How can we teach clinical skills in a cost effective way with sdnimum 
disruption of the service mission of the HMO? Thim question was addressed : 
by Arthur S* Elsteinj Ph.D,, who participated in the Rochester Conference slb & 
oonsultant to the AAMC. In Resource Paper No, 8. HMO Curriculum Development I 
Soto Relevant Instructional Resources , Elsteln and Maatsch describe a number, 
of simulation techniques that can help students improve their clinical skills 
outside the practice setting so as to facilitate effective and efficient use 
of the clinical experience* These include use of simulated or actual patients 
in history taking conmunications skills j a variety of simulation equipment 
for training in different portions of the physical examination; clinical 
algorithms, flow charts, computer-based or paper-and-pencil case simulations, \^ 
and high fidelity simulation games, all for instruction in complex, sequentia;l 
problem solving. 

For teaching HMO concepts to preclinical medical students, we recommend 
the University of Rochester approach which Involves a combination of methods 
including didactic lectures^ student initiated research projects, precepting. 
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one-to-one student Interviews with department heads, and home visits to selacted 
patienta (see pages 16-18) . - 

Are HMO physicians corapetent as educators /pracep tors? Georgetown University 
extended its project by six inonths to develop and Implement a program for training 
physicians as educator/preceptors. The program, described in Resource Paper No. 7, 
A Role Guide and Resource Book for Clinical Preceptors , is highly recoTOended. 

How much time should the student spend in the IMO setting and over how long 
a period? The answers to these questions are beyond the scope of this study. 
Student learning experiences at the participating institutions ranged from a 
one-day experience at RIGHA to two yisars at the Canbrldge Center. Although 
we found the Rochester experience to be effective (the student spends half a 
day per week over a period of fourteen weeks in the ffilO), there has not been 
sufficient experience to make any recommendations In this area. 

HOW AND WHERE DOES ONE BEGIN? (PROCESS) 

Constructing a curriculum In the HMO setting Is an unusually complicated 
process because it involves two institutions with divergent missions (education 
vs. service). Where does one begin and how does one proceed in this joint 
educational effdrt? Who should be involved? Which institution or department 
should take the lead? Is a medical educator needed? Is It helpful to define 
behavioral objectives? To answer the questions we examined a set of selected 
variables related to curriculum development process. The results are presented 
in Table 8-4 and described below. s.^ ■. 
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Table 8-4 

CHAMCTERISTICS OF CURBICULmd DEVELOPlffiNT PROCESS BY INSTITUTION 



WinSX^ScQ L6£^ -Lb UtL 




T! R 


U.P* 




BROITO U, 


HARVARD t 


Institutional lead 
or both) 


school 


hotH 


HMO 


both 


both 




UBpar.cinen cai ±eaa 
(at medical school) 


Medicine 


finramiin it V 

Medicine 


None 


Family 
Medicine 


Community 
Medicine 


Nona' 


Involveroent of 
Curriculum Conmittee 




yes 




yes 






Gonsumer Involvement 


yes 






yes 


yes 


— i 


Participation of 
Educator 


yes 


yes 


yes 


yes 






Defined Behavioral 
Objectives 




yes 


yes 


yes 




yes , 


Conducted 
Field Test 


yes 


yes 


yes 


yes* 


yes 


yes 



* Althougli U.W. did not actually Inplenient Its new ourricui™ It has teen conducting 
educational programs in the IfflO for many yearsj see chaptar 5 for further details^ 
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1- Institutional lead - By Institutional lead we mean which institution, 

the HMO or the medical school, performed moat of the work in initiating* 
developing and implementing the curriculum? It ii somewhat surpriiing 
to find that the HMO and medical achool shared responsibilities, more 
or less on an equal baslSj in one-half of the case^studies. In two 
other casea, the IMOa (both university sponsored) clearly took the lead, 
and in one Instance the medical school took the lead* We note that, 
although the subcontract agreements were made with the unlversItUesVTiti 
five out of the six cases the IttlO was either the clear leader or an 
equal partner in the educational efforti It is obvious that the medical 
schools realized at the outset that It is essential to involve the EMO 
at every step of the projectp We recommend that in future undertakings 
of this nature, the HMO should be at least an equal partner, 

2, Departmental lead ^ By departmental lead we mean the department in the 
medical school which led the curriculum development effort* We found 
that at three inatitutiona the effort waa led by the department of com^ 
munity medicine and at another institution It was led by the department 
of family medicine. At the remaining -two inatitutiona faculty members 
from the department of medicine played leading roles in the project, 
but the program was not initiated by the department* 
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3, Curriculum coimiiittaa - We note that the curriculum committee of the medl 
-school was actively involvad In this project at two out of the four ins t 

tutions in which the medical school participated* In fact^ at each of t 
two inetitutionSp the chairman of the curriculum conmittee directed this 
project. While the sample is too small to draw any objective conclusion 
we believe that the involvement of this coiDnilttee is desirable for legit 
mi zing the program and publicising its results. 

4. Consumer invQlv emant - We examined the extent to which ffilO enrolees were 

, p . ^ 

-. consulted or involved in initiating or implemanting this study at their 
respective institutions. At three institutions there was no evidence of 
involvement and' at the other three institutions the degree of consultatl 
varied widely. Group Health Gooperatlve of Puget Sound was the only IMC 
where the Board of Directors formally approved participation in the prog 
Georgetown University consulted with the advisory boards and interviewed 
patients I and at EIGHA the degree of Involvement of the Board of 
Directors Is^ not specif led, but during the site visit thje Board members 
showed an awareness of the educational program and its ramifications. 
Although few objective conclusions can be made on the basis of this samj 
we note that there was more consumer involvement maong the Independent 
ffl!Os as opposed to the university sponsored ones. Surprisingly, the IMC 
with the most extensive consumer participation (Group Health Cooperativi 
of Puget Sound), is also the one with the most extensive educational pre 
grams . 
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We stronglx recoiranend the early and full involvement of HMO enrolees 
or their representatives in efforts of this nature. They should be 
kept fully informed as to who is paying for the program, how much it 
costs, the degree of student supervision, and other relevant details* 
Failure to consult enrolees could lead to distrust, charges of being 
used as research material, or fear of inadequate student supervision. 
There Is no reason to believe that a fully informed consumer would 
reject the program. In fact, the Group Health example is evidence to 
the cQntrary. Once members are made aware of the program benefits as 
well as the costSj consumers tend to be supportive. 

Educational staff We note that a majority of the participating instltu-- 
tions employed a professional medical educator to assist in the curriculum 
construction process. This is somewhat surprising since educators are not 
frequently employed In medical schools and^ moreover * the employment of an 
educator was not a criteria, either explicitly or implicitly, for partici- 
pation in the project. We found that their skills were eKtremely valuable 
at every stage of the curriculum construction effort. We recomend the 
employment of medical educators in future undertakings of this nature. 

Behavioral obiectives Most of the institutions defined their curriculmn 
objectives in behavioral terms, i.e., in terms that can be measured and 
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evaluated* We note the strong correlation between variables 5 and 6, 
the employTnent of an educator and the definition of behavioral objectives. 
The definition of behavioral objectives is the moat crucial step in the 11 
c'jrrlculum construction proceae. Defined in sufficient detail, they 
constitute the content of the curriculum* 

?• Conducted field test We note that every institution implementad their 

program although this was not a requirement of the contract. The partici"" 
patlng Institutions realized that curriculum development without field 
testing is of limited value, and that the field test is an essential tool 
in initial evaluation, 

WHAT DOES IT ALL COST? 

i 

As we indicated in Chapter 1, assessment of the educational costs "'i 
in the IWO was not required under terms of the AMC contract with DHEW, 
but was required under the terms of the AAMC agreement with the Institu-- 
tions. The AAMC felt that it was Important to determine, to the extent 
possible, the cost of education, especially in an ©10* As long as the 
costs are unknowni there will be continued resistance to education ^ - -t 

and justifiably so - on the part of mO managers* Many IMOs are operating 
on a financially marginal basis and they must keep their rates competitive* 
An IBIO manager cannot make an intelligent decision about the program unless 
he has some idea of Its costs, .'^ 

The major accomplishments in costing were the ' developTOent of a conceptual ''V 
framework for estimating the cost of education in an ©10 and the preparation of f 
three preliminary cost studies* The conceptual framework was developed by 



Christine E, Bishop* Ph*D,, and Is presented as Resouree Paper No» 14. 
Two of the case studies were conducted by the Seattle and Camhridga groups 
and are presented as Resource Papers Noe# 15 and 16. A briefer study pr©'- 
pared by the Rochester group is smmarized in Chapter 3. Ideally s the 
conceptual framework should have been developed prior to the initiation of 
the cost studies* Unfortunately ^ because of time pressures and other unfore** 
seen circumstances, Dr, Bishop was not employed until the studies were well 
underway* 

The Conceptual Framework ^ An ffilO-based education program produces not only 
costs* but also benefits to the WiO and its members. Unf ortunately * the benefits 
are* much more difficult to measure and estimate than the costs. Technlquea fw 
measuring such benefits as improved quality of carep increased staff satisfaction, 
or recruitment of high quality staff* are either not known at this time or are 
too expensive to implement* Bishop discusses some ways in which benefits may 
be taken into account* 

Although costs are easier to measure, determining which costs are applicable 
is not as easy as It seems. To determine the cost of an education program we 
must ask ourselves the following questions i 

1* Whose costs are we concerned with? If we are only interested in the cost 
of the education program to the 1010 , then the students' transportation 
costs, for example , are not a program cost as far as the ffllO Is concerned. 
Neither is the medical school's administrative costs, although these costs 
are of great concern to the medical school* To ke6p the cost issue within 
manageable proportions, we decided early on in the project to consider only 
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the costs to the IWO* 

2. ^ l^at are the objectives of the WlOl How do the costs under consideration 

affect these objectives? The principal objective of most IWOs is to 
maximize the benefits to the membership > but this is not alwasy the case. 
The objective of a for-profit ffllO is to maximize profits, while the ob- 
jective of a physician-controlled WIO might be to imprbve the physicians^ 
professional environment or standard of living* If the cost under consider 
ation has no Impact on the achievement of the ffllO's objectives ^ it Is not 
considered a cost. 

3. What are the incremental costs of the education program? That is, what are 
the costs with the education program less the costs without the program? 

4. How do we handle costs that are not easily measured? 

5. What are the short-term versus long-term costs? For example ^ the space 
costs for a developing IMO, in which the facility is underutilised mighty 
on a long-term basis, be considerably higher than current space costs. 

A detailed discussion of these questions constitutes Bishop -s conceptual 
framework. 

The Cost Studies - The three cost studies constitute initial steps In the devel 
opment of a cost methodology for measuring educational costs In the IWO. A 
eutmary of selected data from the three studies is presented on Table 8-^5 on 
the following page. A cursory inspection of the table reveals that the data 
are not comparable and great caution should be used before drawing any conclu 
sions. The University of Washington and Harvard University have continued 
their cost studies since the preparation of the Initial reports and are now 
in the process of refining the data and updating their reports * 

121 



Table 8-^5 



THE COST OF EDUCATION IN THE mOl TENTATIVl DATA 



Institution Educational Number of Duration Goats 

Level Students 



Genesee Valley 1st year 12 13 half-days $157 per student or 

Group Health medical .for 1 semester $1880 for the course 

Association students . 



Group Health 
Cooperative of 
Puget Sound 



HCHP- 

Cambridge 

Center 



1st year 

medical 

students 



175 



2nd year 

medical 

students 

3rd year 

medical 

students 



Family 

Practice 

Residents 



Internal 
Medicine 
Residents 



12 



4 



2 half-days/ 
quarter J for 
3 quarters 

1/2 day/week/ 
quarter 

1/2 day/week/ 
quarter 



40 days 



0 - 



6 months 1 
full ttae 



$4*30 per student^day d 
$225 for the course 

$79 per student^day Drv| 
$4,708 for the course 



$53 . 20 per s tudent-day 
or 

$2,123 for the course . 



Nut Available $15 |013/resident/year < ; 



$2|100/resldent/year 



Excludes productivity loss by preceptor resulting from time devoted to teaching* 
This accountSi in part* for the difference in resident training coats between 
Harvard and Group Health, 
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IS THE CUMICULUM ACHIEVING ITS PURPOSES? (EVALUATION) 

The importance of defining clearly the objectives of the educational 
program was amphaslEed earlier in this report. Once the program has been 
implemented^ we must ask ourselves whether the objectives have been TOt, 
Have the students learned about' IMO'a? ' Have their attitudes toward primary 
care changed? Have career plana changed as a result of the program? For 
if the program does not accomplish what it set out to do, either the program 
or the objectives need to be altered. 

Although this was not required under the terms of the contract with 
DHEW, three institutions spent considerable tiine and energies in developing 
evaluation methodologies and two of these Institutions actually field— tested 
evaluation Instruments- The evaluation methodologies md their results are 
preeented in Resource Papers Nos* 9^13- Brief summaries of these papers can 
be found in Chapters 3-5, 

The three institutions p Penn Urbp GVGHAj and Group Health Cooperative 
of Puget Sound j used a variety of evaluation me: i.ogies and Instruments , 
each with its own advantages and limitations* The Penn Urb evaluation 
Instruments J developed by Dr, Edwin Hutchins* w^re designed with two major 
purposes in mlndi (1) For replicablllty In other ffilO settings | and 
(2) For long range evaluation , especially with re met to career choice . To 
achieve repllcabllltyp each of the other participating Institutions was re^ 
quested to contribute test Items that have general applicability to IMO-based 
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educational prograffls. The results of the first field test on a group of 
27 atudents Indicated .that additional work and testing is necessary. . _ _ 
HQwever, further developmental work was discontinued as of March 30s 1976, 
for lack of funding. The feels strongly that this effort deserves 

support and should be continued to its completion. Dr. Hutchlns has expressed 
great Interest in this and we hope some means can be found to support the 
continuation of his work. 

The University of Rochester group developed a series of evaluation Instru^ 
mento which were field-tested on first--year medical students and tw© control 
groups (see Resource Papers Nos. 10-12). The evaluation design includes a 
comparison between the group of students which participated in the program 
and a group of students which did not participate and the results Indicate that 
there were small but significant differences in a few areas* The evaluation 
methodology relies heavily on sophisticated statistical techniques, the analysi 
of which could conceivably cost more than the program itself. 

The University of Washington group developed a series of nine evaluation 
Instruments for its proposed clinical clerkship at Group Health* Most of the 
instruments were adapted from similar ones currently in use at the medical 
school. However p neither the instruments, which are presented In Resource 
Paper No. 13, nor the clinical clerkship for which they were developed have 
been field-tested. The package offers other institutions a rich selection of 
evaluation Instruments, including instrtments designed for student evaluation 
of faculty and course content ♦ 



PROJECT PARTICIPMTS 



PROJECT ADVISORY COMMITTEE 



Samuel J, Boschj M,D* i Chairman^ Project Advisory Cottmitteal Associate 
Profeesor, Department of Coraiunity Medicine , Mount Slttal School of 
Medicine of the City University of New York, New York, New York 

Joel J. Alpert, M*D*s Chairman, Department of Pedlatriea, Boston University 
School of Medicines Boston, Maesachusette 

Jack Di Myers, M.D., Professor of Medicine, University of Pittsburgh 
School of Medicine, Pittsburgh, Pennsylvania 

Mitchell T. Rabkin, M*D., General Director, Beth Israel Hospital, Boston, 
Massachusetts 

John P* UtE, M.D,, Dean, Georgetown University School of Medicine, Washington, 
D*C. 

Eugene Vayda, M*D., Professor and Chairman, Department of Health Administra- 
tion, University of Toronto, Toronta, Canada 



PROJECT S TAFF 



James 1, Hudson, M*D., Project Director, and. Director, Department of Health 
Services , A^C 

Marcel D* Infeld, M*P*H,, Project Coordinator, Department of Health Services, 
AAMC 



SPECIAL CONSULTMTS 



Christine Bishop, Ph.D., Assistant Professor of Economics, Boston University 
School of Management, Boston, Massachusetts 

Arthur Elstein, Ph.D., Associate Director for the Office of Medical Education, 
Research and Development, Michigan State University, East Lansing, Michigan 

Edwin B. Hutchins, Ph.D., Dean of Faculties, Indiana University-Northwest 



r # - 



1 25 



PROJECT PARTICIPANTS (Cont.) 



GEORGETO™ UNIVERSITY AND 
GEORGETOWN UNIVERSITY COMMUNITY HEALTH PLAN (GUClff) 

David L, Rabins M^D., Project Co-Director^ and Professor, Department of 

Cormunlty Medicine and International Healthy Gaorgetown University 

School of Medicine 
Mr, John L* Simon, Project Co-Director, and Instructor^ Department of 

Community Medicine and Interaational Health, Georgetown University 

School of Medicine 
Paul Lalraen, M*D, , Executive Vice President for Clinical Services, 

Georgetown University Coimnunlty Health Plan 
Mst Kristin K, Spector, Planning Associate, Georgetown University School 

of Medicine 

UNIVERSITY OF ROCllSTER AND 
GENESEE VALLEY GROUP HEALTH ASSOCIATION (GVGM) 

Sanford Meyarowitg, M.D., Project Director^ and Associate Dean for Medical 

Education, University of Rochester School of Medicine and Dentistry 
Harold H. Gardner, M,D,, Project Co-Director, and Director, Joseph P. Wilson 

Center* Genessee Valley Group Health Association 
Warren Glaser, M.D,, Project Co-Director, Professor of Medicine and Coordi^ 

nator fc 
Paul L* Grove 

Communication, University of Rochester 
Mr. Michael M, Ravitch, Associate, Division of Medical Education and Coimnunl" 

cation. Assistant Professor of Education, University of Rochester 



iser, M.D,j froject uo^Lti-rector , rjtuii^^sui ^^. 44^1^^^*"^ - — 

cor Ambulatory Care, Department of Medicine, University of Rochestei 

rover, Jr., Ph,D», Assistant Professor of Medical Education and \ 



UNIVERSITY OP PENNSYLVANIA AND 
PENN URBM HFJ^TH MAINTENMCE PROGRAM (PENN URB) 

Charles G, Hertz, M.D,, Project Director, and Medical Coordinator, Penn 
Urban Health Maintenance Program j T^ # 

Edwin B. Hutchins, Ph.D., Educational Consultant to Penn Urb, and Dean of 
Facultiaa, Indiana Unlverslty-^Northwest . 

Ms, Stephanie Kallen, Educational Program Development Specialist, University 
of Pennsylvania 

Mr Thomas N. Perloff , Administrator, Penn Urban Health Maintenance Program 
Patrick B. Storey, M.D., Director, Penn Urban Health Maintenance Progr^ ; ■ 
Ms. Harriet Williams, Educational Coordinator, Penn Urban Health Maintenance 
Program 



~ m - 



126 



-lib- 



PROJECT PARTICIPANTS (Cont.) 



UNIVERSITY OF WASHINGTON MD 
GROUP HEALTH COOPERATIVE OF PUGET SOUND 



Gary E, Striker, M.D., Pfoject Co-Director, and Assistant Dean for 
Curriculum, University of Washington School of Mediclna 

John S. Gilsont M*D,» Project Co-Director, and Director of Medical Edu- 
cation, Group Health Cooperative of Puget Sound 

Frank Evans, M.Ed., Office of Research in Medical Education^ University 
of Washington School of Medicine 

Gregory L. Pawlson, M.D., Senior Fellow^ Departoent of Medicine, Univer- 
sity of Washington School of Medicine 

Richard Watkins, M.D,, Staff Physician, Group Health Cooperative of Puget 



David S. Greer, M,D,, Project Co-Director, and Associate Dean of Medical 
Affairs, Division of Biological and Medical Sciences, Brown University 

Albert F, Wessen, Ph*D,, Project Co-Director, and Chairman, Section of 
Coimnunity Health, Division of Biological and MedjLcal Sciences, Bro^ 
University 

Robert G. Rosenberg, M,D* , Medical Director, Rhode Island Group Health 
Association 

Mr* Kenneth L. Sirmnons, ^ecutive Director, toode Island Group Health 
Association 



Matthew A. Budd, M.D,, Project Director, and Staff Internist, Harvard 

Community Health Plan-Cambridge Center 
Charles J, Hatem, M.D,, Assistant Director of Medical Education, Mount 

Auburn Hospital 
Burt Johnson, M.D,, C^brldge Hospital 

Robert S, Lawrence, M.D, , Acting Chief, Department of Medicine, Cambridge 

Hospital; Director, Harvard Prtaary Care Program' 
Donald R, Lipsitt, M.D., Chief of Psychology, Mount Auburn Hospital 



Sound 



BROWN UNIVERSITY MD 
RHODE ISLAND GROUP HEALTH ASSOCIATION (RIGM) 



HARVARD UNIVERSITY AND 
HARVARD CO^NITY HE^TH PLM (HCffi-CC) 



EKLC 



127 




m 



MSOURGB PAPERS 



1. Curriculum Deyelopment P^E^oaege 

1. DESIGNING A CURRICULUM IN A CLINICAL SETTING : M ITERATIVE PROCESS 
Charles G. Hertz, H*D* , et al,, (University of Pennsylvania) » 
scheduled for publication in the October 1976 Isiue of the 
Journal of Medical Education. 



II* Curriculuin Content 



A ^EDICAL STUDENT'S GUIDE TO HE^TH MAINTENANCE 0R6MIZATI0NS 

John L. Simon, at al. , (Georgetown University) , June 1976. 

A CURRICULUM FOR FIRST-YE^ MEDICM. STUDENTS I OBJECTI^Bj SEMINARS, 
INTERVIEWS AND RECOMffiNDED RE^INGS 

compiled from the University of Rochester's fljaal report to the 

MMC, December 1975. 



CURRICULUM MODULES i RAT10NM,E, OBJECTl^Ss MEmODS AND PREREQUISITES 
from the. University of Pemisylvmia final report, December 1975, 

PROPOSED CLE^SHIP FOR THIRD YEAR JffiDIC^ STUDENTS : OBJECTIVES , 
INSTRUCTIONAL ^ffiTHODS MD EV^UATION 

Appendix J of the Univeraity of Washington final report, 

Deceotoer 1975. 



CLINICAL OBJECTIVES FOR A PRIMLY CARE ffiSIDENCT IN IN^RNAL MIDICINE 
from the Harvard University final report, December 1975. 

Ill, Instructional Methods 



7. A ROLE GUIDE MD RESOURCE BOOK FOR CLINICAL PRECEPTORS 

John L* Simon, (Georgetowi University), Jime 1976. ^ 

8. HMO CUMICULUM DEVELOP^ffiNT^ SOm RELEVANT INSTRUCTIONAL RESOURCES 

Arthur S. Elstein, Ph.D* and Jack L. Maatsch. ■ - ^ 

- 128 . . - ; ; .vi^ 



3. 



4. 



5. 



Progrmm EvaluatlQn 



9. REPORT OF EFFORTS TO DEVELOP A STMDAraiZED TEST OF MOWLEDGE AND 
ATTITUDES RELEVANT TO THE HMO SETTING 

Edwin B* Hutchlnsj Ph*D. , March 30^ 1976, 



10, AN HMO BASED PRIMARY CURRICULUM FOR FIRST YEAH MEDICAL STUDENTS ~ 
DESI^, EVALUATION AND DISCUSSION 

Paul L. GrovaTs Jt. , et al. ^ (Univaraity of Rochester)^ submlttad 
for publication to the Journal of Itedieal Eduoation, Jmia 9* 1976. 

11. ISSUES MD METHODS IN CURRICULUM EVM.UATION 

Paul L* Grovars Ph.D., and Michael M. Ravltch, Journal of Medieal 
Education, Dacamber 1975. - 



12. EVALUATION INSTRUMNTS 

from the Univaraity of Rochastar final report, Daeamber 1975* 



13. PROPOSED EVi^UATION INSTRUMENTS 

Appendix K of the University of Washington final report, 
Dacatriber 1975. 



Educational Coats 



14- ^ffiASURING THE COSTS AND BENEFITS OF MEDICM. EDUCATION IN THE mo SETTIN( 
Christine E. Bishop^ Ph.D. ^ January 1976. 

15, COST BENEFIT ANALYSIS 

Section V of the University of Washington final report, 
Da center 1975* 



16. mASURING THE COSTS OF PRIMARY CAKE MSXDENCT TUNING 

Part III of the Harvard University final report, Decembar 1975, 



Resource Paper No. 1 



DESIGNING A CURRICULUM IN A CLINICAL SETTINGS 
m ITERATIVE PROCESS 



Charles G. Eertz, M.D. 
Madioal Coordinator ^ Penn Urban 
Health Maintenancs Progrrain; 
Associate Cliniaal Professor of 
Pediatrias and Comnunity Medioine/ 
University of Pennsyivania * 

Harriet Williams ^ B«A* 

EduGational Coordinator^ Penn Urban 

Health Maintenance Program 

Edwin Be Hutchinsi Ph*D* 
Consultant to Penn Urban Health 
Maintenance ProgrMi 



The work upon which this publication is baaed was perfomed 
pursuant to Contract # NOl - MB-44009 with the Association /of 
American Medical Colleges and the Bureau of Health Manpower ^ 
Health Resources Administration, DHEW, 

* 415 eouth 19th Street, Philadelphia, Pa, 19146 



130 



ABST^CT 



A curriculuin for the training of medical studants was 
designed and implemented in a functioning clinical setting. 
The multi-disciplinary, multi-professional staff of a primary 
care center participated with professional educators in an 
iterative process for curriculum development* A three-stage plan 
was conceived^ behaviorally oriented educational objectives 
were constructed , instructional methodologies to satisfy these 
objectives were created, and evaluation instruments were designed^ 
Throughout each stage, the educators facilitated the process by 
teaching the staff the necessary techniques for the design and 
implementation of the curriculum. The curriculum that resulted 
from this process is focused on those issues that are important 
to team delivery of primary care* An important outcome of the 
project is the increased enthusiasm and competence of the pro- 
fessional staff in the teaching of students in the health pro- ' 
fessions. 
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DESIGNING A CURRICULUM IN A CLINICAL SETTING: 

AN ITERATIVE PROCESS 

INTRODUCTION 

- _ . - - * 

The patterns of health care delivery in the United States 
are undergoxng major changes. In settings such as HMOs, 

teams of professionals from various fields are working oollegially 
to provide comprehensive and efficient health care. At the 

same time we are witnessing the emergence of the patient as 
an active and knowledgeable consumer of health care."'^ However, 
medical school education has done little in training physicians 
to meet the demands of participation in alternative forma of 

6,7 

health care delivery. 

As a way of encouraging medical schools to become more 
actively involved in teaching the changing patterns of health 
care delivery, DHEW awarded a contract to the Association of 
American Medical Colleges "to support the development of 
curriculum for physician training in academic medical center 
HMOs." The concern underlying this award follows: "If HMOs 
are to expand and become a viable alternative system of health 
care, appropriately trained manpower must be available." 

This paper describes the process by which one university 
related HMO, the Penn Urban Health 'Maintenance Program (Penn- 
Urb) , met the terms of the Association of American Medical 
Colleges grant. The project was an attempt to enrich medical 
education by creating a new curriculum that would prepare 
medical students to function knowledgeably and enthusiastically 
in multi-professional primary care settings. This curriculum 
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was designed through the use of an iterativQ procesB involving 
both professional educators and health care providers in a 
functioning clinical setting* 
SETTING 

The Penn Urban Health Maintenance Program is a primary cars 
center located in urban Philadelphia, Comprehensive primary 
health care is provided to a iocio--demographically heterogeneous 
population through both the prepaid capitation and fee-for- 
service financing mechaniBms, Penn-Urb is a multi-^dlsciplinary ^ 
multi-professional group organized in teams in the primary care 
disciplines! health care for adults^ health care for children 
and adolescents/ health care specific to women, psychosocial 
health care, and dental health care. The multi-^professional 
staff is composed of physicians, nurse practitioners, a physician's 
assistant, dentists, a social worker, an economist, a sociologist, 
a librarian, and an , educator, as well as clerical and technical* 
support staff* 

Since Penn^Urb has been operational for less than three 
years, its clinical staff is sufficiently small to function 
as a unified group* Currently, that staff, which consists of three 
internists, two pediatricians, . an obstetrician-^gynecologist , a 
psychiatrist, four nurse practitioners, a phyaician's assistant, 
a social worker and two dentists, provides 18,000 patients visits 
a year. The patient population is currently increasing at a rate 
of approximately 5% a month. 

Penn^Urb, which is sponsored by the University of Pennsylvania 
was formed as a model unit? as such, it is a setting in which educa 
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tion and research, as well ae earvice, are integral components of 
the organization* Although the professional staff considers student 
education a legitimate organizational function, it regards direct 
patient care as its most important and Ghallenging function. 

The project described here was designed to improve the 
quality of education offered to the students by the health care 
providers. The professional educators assumed that the more 
involved the health care providers became in the process of 
curriculum deslgiv the more their enthusiasm for participating 
in the educational endeavors of the organization would increase. 
Since at the start of the project , many of the health care 
professionals regarded education of students as a burden , an itera- 
tive process served to involve them gradually in curriculum 
development* At each stage of the project, professional educa- 
tors worked with small groups of health professionals to teach 
them the educational principles on which a curriculum is built. 
Frequent short meetings between the educators and the health care 
providers were planned for several reasons* The demands of the 
practice made long contacts difficult to schedule* Also, the 
amount of educational Information to be transmitted to the pro- 
viders would have been overwhelming unless presented gradually. 
The iterative process allowed an opportunity for the educators 
to reinforce the providers' growing educational competence and 
interest during each stage of the project. 

The Association of American Medical Colleges contract men^ 
tioned earlier specified that the Univereity "would undertake to 
work in the development of curricula for -raining medical students 
^ in the University affiliated health maintenance organisation (HMO)." 
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The scope of the project was broadened at Penn--Urb| however^ 
to allow the training of other health prof assionals in a 
multi-^disclplinary, multi--pro£essional team setting. 
PLAN 

A 3* stage plan was conceived to carry out the curriculum 
design project* 

1^ Initial decisions v/ould be made about the scope of the 
content domain • 

2. The specific items to be included in the curriculum 
would be classified according to a standard taxonomy 
of educational objectives*. 

3* Detailed curricular plans ware to be designed to meet 
the educational objectivea. 

The medical coordinator of Penn-Urb^ who was also the project 
director r made several decisions at the outset of the project. 
The first was that the technical knowledge essential to the 
development of a sound curriculum should be pro\fided by an 
expert in the field of education. It was felt that health care 
providers generally lacked the necessary training to design the 
truly innovative curriculum that was called for* Further, an 
explicit goal of tJie project was to upgrade the teaching competence 
of the health care professionals through their participation in the 
design and dnliver;^^ of the curriculum. Therefore, a search was 
conducted for a professional in the field of medical education 
who had previous experience in stimulating cooperation among 
educational experts and several types of health professionals. 
He was to work with the project as a consultant, charged with 
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the responsibility for implementing the overall plan. The 
educator at Penn-^Urb became the educational coordinator for 
the project^ and assumed responsibility for the daily super- 
vision of the project* 

Another decision was made to include the entire profes*' 
sicnd, staff in the project's design and implementation i A rationale 
of the project was to increase the interest of the staff in the 
teaching of medical students^ but since these medical students 
were to be trained to function as members of multi-professional 
teams, it was also considered important for them to be expert u 
to all professionals I not simply to physicians* 

Those aspects of medical education that are part of the ; 
traditional medical school curriculum were not to be included 
in the Penn-Urb curriculum* The educational focus of the Penn- 
Urb curriculum was to be on the unique features of the delivery 
of health care in a rationally designed multi-professional 
primary care setting. As such^ it would be potentially applicable 
to health professional students from fields such as nursing, 
social work, health care administration, the allied health 
professions and dentistry* 

CREATION OF EDUCATIONAL OBJECTIVES 

Efforts were niade to involve the professional staff as early 
as possible. A rough outline of possible curriculum items was 
generated by the educators. The items were divided into six 
sectional 
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1. Primary health care/comprehensive car^j definitions 

and characteristics of the eystem. 
2* The health care team i roles and responsibilitiee of 

different health care practitioners in a primary health 

care team, 

3. Active consumer participation in an organised health 
care setting. 

4. One quality health care for all, 

5. Economics of HMOs. 

6- Soclologic viewpoint on innovation and organisational 
change* 

The curriculum items were presented . in a behavioral objectives 
format* This rough notion of a curriculum was intended to 
generate criticism and comment from the professional staff. 
The behavioral format was introduced so the educators could 
discuss with the staff the importance of behaviorally stated ' 
objectives as the basis of a rationally designed curriculiim. 
As an example, one item in section 1 of the original outline 
follows: 

1*2 The student should be able to articulate, the_impetus 
for the development of organised systems of health 
care delivery, in terms of 
1*21 Maldistribution ol! service 
1*22 Overopecialigatioii 
This set of objectives was presented to the staff in a 
series of structured interviews between pairs of professionals 
and an educator. The staff members were asked to comment on the 
relevance and correctness of each item. They were then asked to 



generate otha^ items they considared assantial to the aurriaulim. 
These interviews alsq provided an opportunity for the educators 
to explain the rationale guiding the project^ the etrategies 
involved in writing behavioral objeetivesV and the steps that 
would be taken to oomplete the project* 

When the interviews were completed, the educators rewrote 
the educational objectives in line with the staff's feedback. 
This new document was then circulated among the staff for 
further revision and comment* Once again t the Penn-Urb staff 
suggested many changes that were incorporated into a third 
version of the objectives* Its substantive comments indicated 
that the iterative process had, in fact, proved successful 
in involving them in the curriculvun development. It was obvious 
both to the educators and to the health care providers that the 
objectives now reflected educational material that the providers 
actually wanted to teach to the students* As an example of the 
scops of the revision provided by the prpfessional staff, the 
final form of the educational objectives for the previous example 
follows: 

1*2 Given an open-^ended question on health care delivery in 

America, the student should be able to state the following 

factors underlying the development of HMOs* 

1*21 If aBked about the distribution of health care the 

student should be able to indicate the range of 

patient/physician diatribution* 
1,22 If the student is asked to describe the role of the 

profit motive in shaping traditional private praotiae 

he should be able to do so. 



1.23 The student should be able to answer questions 
on the U.S, Goimnitmant to health care del ivary 
using eomparative material from other national 
systems. 

DESIGN OF INSTRUCTIONAL TECHNIQUES 

Meetings of the entire professional staff of Penn-Urb were 
also used by the edUGators to teach the staff how to design 
instructional modes to, meet the educational objectives* The 
process of matching instructional strategies to particular 
objectives was detailed, ' and many examples of instrugtional 
methodologies were provided. The staff was asked to divide into 
groups, each of which was charged with refining the objectives 
for a specific section of the curriculmn and creating the metho- 
dologies for that section. The six groups met approximately 
twice weekly until the task was completed. At each group meeting^ 
an educator was present to facilitate the progress of the group.. 

During the group meetings , the educators once again described 
the range of available instructional modes. Many instructional 
options were presented to the groups, including the creation of 
audio-visual materials, the construction of bibliographies, and 

opportunities for students to participate with multi-pro- 
fessional teams in the provision of health care. The groups 
were encouraged to match educational modes to fit the content 
of each objective. The educators also stressed the advantages 
of active participation! rather than passive listening, for 
the learning process* 
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THE CURRICULU M 

An innovative curriculum useful in a variety of formats 
resulted from this project. The Penn-Urb staff offers three 
courses to undergraduate medical students i a one-week inten- 
sive interdisciplinary lecture course, a longitudinal course 
in which the student participates in the care of selected 
families, and a one-month clerkship at Pann-Urb. The clerkship 
was chosen as thw focus of ^hi KSHiiilar eff 
presents the opportunity for most intensive exposure to Penn- 
Urb. The clerkship, an elective experience offered to under- 
graduate medical students who have completed the basic clinical 
courses, now provides a structured, intellectually stimLilating 
experience, as well as clinical practicuum in primary care, as 
a result of the curriculum development project. The enriched 
curriculum is typified by Section 4, entitled "One quality 
health care for all." a pediatrician, an adult nurse practi- 
tioner, and a physician's assistant were responsible for the 
design of the instructional techniques for this section. This 
group decided that the medical students should learn how, well 
the health care system in the United States meets (or does not 
meet) four criteria j accessibility, accountability, continuity, 
and comprehensiveness. To meet this objective, several strate- 
gies were adopted. T bibliography on the state of the current 
health care delivery system in the United States was assembled. 
After the students complete the reading, they are asked to 
interview three patients at Penn-Urb about the quality of their 
current and past settings for health care with respect to the 
four criteria. A structured interview form for student use was 
created by the professional group. After the students interview 
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patients I they viaw a videotape made by the group who designed 
this section of the ourriGulum. The tape contains in*depth 
interviews with three patients of different socio-economic 
claaseB concerning their successes and failures in obtaining 
satisfactory primary health care. The last step for the 
students is a meeting with the members of the staff to eKplore 
reactions to the issues raised by this section of the curriculum* 

Since Penn-^UrB*s orgariizational sW 
opportunity for medical students to participate in ^ the team 
delivery of health carer the section entitled "Health care . 
team" is a central component in the curriculum. There is a 
bibliography available on the roles of the non*- physician provider 
in the delivery of health care^ and the students spend approxi" 
mately 1/3 of their time at Penn-*Urb working with these kinds 
of providers. The specific contributions of the non-physician 
providers to the health care of the patients are emphasized. 
Further^ the active .participation of, the entire professional - 
staff in the presentation of the curriculum reinforces the 
notion of nurse practitioners , physician's assistantSf and 
social workers as colleagues* 

Although the professional staff was asked to focus on the 
medical student clerkship in its curriculum design efforts , 
the instructional strategies ware easily adapted for other uses. 
The staff at Penn-Urb hao offered a course to students from 
several health professional schools at the University of 
Pennsylvania* The course , which is entitled "Introduction to 
Comprehensive Health Care Systems," is taught twice yearly as an 
intensive one-week experience to medical^ dental, nurslng# allied 
health professions, health care administration and social work 



. , students. The educational objectives eerved as a guide for 

the organization of the course, and the instruetipnal strategies ' - 

were adapted for use with a large group wherever possible , 

Another benefit of the curriculum project was that each meniber 

of the staff was prepared to teach some part of the course 

and can therefore participate substantivelyin the course, 5 

EVALUATION . 

The iterative process used in the curriculum planning 
extended as well to the evaluation design. Initially/ the 
educators described to the provider staff their previous experience ^ 
with evaluation of medical students, especially with resoect to 
career attitudes, career choices, critical incidents, medical 
school environment, and interpersonal perceptions as measured 
by semantic differential, -^'^^ 



The staff, in dialogue with the educators, then pro- 
posed areas for evaluation, based on the educational objectives 
of the curriculum. It was decided that evaluation should focus 
on areas such as: 

® attitudes toward various types of careers within medicine, 

* attitude measures relating to other health care team 
members, ' ' 

* tests of knowledge about specific aspects of primary 
comprehensive care and HMOs, 
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^Thaeauca tors specified the most appropriate formats for 
testing, and thf health cars providars aasumed the responalblity 
for generating the popl of quastions from which the final tasting 
tools were created. The product of this iterative eKereise is a 
series of evaluations which provide diagnostic and summative 
evaluative data. 



RESULTS 



The curriculum development project was succassful in meeting 
the initial plan. A curriGulum for the medical student clerks 
was deyelpped,' this curriculum has bean adapted easily to the 
reguirements of the lecture course taught by the Penh-Urb staff, . 
The objectives are an explicit statement of the curriculum content 
that the Penn-Urb staff feels it should teach to 'students in the 
health professions. Since the educational objectives of Penn-Urb 

^P®^"-*'^' ®® "P*' to o^fer courses arise, 

Pann-urb has available the basis of a sound curriculum on which 
to build. Further, the object^es will serve as the core around 
which a curriculum for students in the other health professions 
will be constructed. The core contains cognitive and affective 
objectives that are applicable to students from many disciplinesi 
what remains to be designed are those objectives that will focus 
specifically on the roles of the non-physician professionals 
in the clinical setting, , 
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It would appear- that including the entire professional 
group in the design of the curriculum for medical students 
contributed significantly to the success of the project. ' 
The educational objectives embody a broadir range o,f topics 
than they would have had they been created by the educatora and 
physicians alone. 

pother outcome of the project is that the professional 
staff has become more iirectly involved in the process of 
educating medical students. As the Penn-Urb staff has parti- 
cipated more fully in the educational planning of the organi- 
zation, its commitment to providing education has also increased 
The overall result is that a structured, substantial curriculum 
is now being offered enthusiastically to students at Penn-Urb- 
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CU^CULIM OBJECTIVES 



crlculum Obiectlveg ■ 

A, Cognltiva Objeatives - By the completion ©f and con.qletent with the 

material presented In the eoursep thk student ihould be able to J 

1* Define the structure end/or describe the function of the following 
priinary care system oomponentsi 

Primary Care 

Family Medicine 

Urgent Visit Clinic 

Pre-paid Group Practice 

Centralized Appointments 

Financing p Marketing, Hoepltmlizatlon 

2i Describe the function of the following personnel i 

Nurse Practitioner Licensed Practical Nurse 

Primary Care Physician House Officer 
Medical Social Worker Intern 
Hedical Secretary Optometrist 
Receptionist Physical Therapist 

Patient Advocate Occupational Therapist 

Dietician _ _ ^, Psychiatrist 

Medical Specialist Psvcholoplgt _ _ _ 

Staff Nurse 

3, Describe and contrast In written form the structure of at least three 
types of Health Maintenance Organizations, Including One Closed-Panel 
Prepaid Group and One Open-Panel Foundation, as toi 

Pinancing 

Organisational Hierarchy 
Marketing 
Hospitalization 
Legal Basis 

4i List the standard procedural steps for a) Client Registry and 
b) Patient Processing at the HMO. 

5, Observe and describe in wrltten^^form the process whereby at least two 
clients Joined the HMO including the following phases i 

Foms of Initial contact 
Comparison of fomata 
Bases for decision 
Administrative processing 

er|c iar 



Collect through interview and describe in written form those expecta- 
tions which at reast one patient held for the following HMO staff befor 
and after receiving caret 

Primary Care Physician 

nedlcal Specialist 

Nurse Practitioner 

Receptionist 

Other Staff Encountered 

Observe ;and describe In written log fora the process whereby at leas t__ 
one client entered and was served by the HMO for a) routine examlna* 
tion and b) specific complaint , including the following components: 

a* Reasons and timing/presenting complaint 

b* Telaphone number 

c. Appointment mechanism 

d. Entry points 

e* Identifying information 

f . Sequence of HMO personnel contacted including their decisions and 
actions 

g. Mechanisms to detect unidentified Illness and monitor personnel 
performance 

h* Any ehlft or conflict in patient e^qpactationB 

■ 

Construct a written operational analysis of the roles and relation- 
ships of the HMO staff includingi 

a* Dlvlaion of labor 

b* Hierarchy of patient distribution 

c* Referral decision points 

d. Ranges of diagnostic specificity 

e* Admlnis tratiive accountability 

Construct a written operational analysis of the tasks of the primary 
care physician including clinical eKamples of the following 
components i 

a. The setting in which the physician/patient encounter takes place 

b. Assessing Initial complaint through observation of patient's 
behavioral and physical characteristics 

c. Forming first order hypotheses 

d. Hypothesis testing by further IntervlCT^i physical examinationi 
laboratory and special diagnostic procedures 

e. Assessing psycho-asocial health modifiers 

f. Weighting comDlalnts 

g. Describing relevant social context 

h. Identifying and classifying problems (Weed) 
1. Forming specific diagnoses 
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^Sfb^V^f'^""'"' corrective measures relative to the 

. avaUabUlty, continuity and comprehenslveneaa of care, glvem 

b! The^"uSer""df eantalnlng e«e syste. Inadequaclea, 
Affectlva Objectives 

1. Attitude Questlonatre - Maintain or Increase Post vs. Pre score on: 

Attractiveness ranking of specializing In Internal Medicine 
Pediatrics, or Family Medicine as oomlared wltHther sp«Ultl.s 

^ ™pared"o"oth1't"">'' co„prehen^?^eness 

as Qompared to other charaetarlstlas 

Osgood Semantic Differential applied to Role of Prlnary Care 
i RaSLI^of P'-tltloner. Health Malntenance^^a^l'^tlon 

T^^z:^- :rt^:i^s;.rita:: ""^ - 



a. 
b. 
c. 



e^nerlencf ■ L°L^"f' students will select HMO elective • 
experience in second year 

reaulreS f?f f H^""''^??" "P^"^ Ihr/wk above 

required elasi hours at Wilson Center 

duc^d W ^,1","^^""'^^"^ -"^'^ ^hat of projects p^o= 
" Z . - choosing other task force options 

3. Course evaluation questionnaire - student ratings efi 

a. Course and 

b, Instwctors for the first year course In Coimunley. Medlelne, 
HMO subgroup will equal or exceed these ratings given by BOX 
of the course's other task forces 
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the sminars 
curricul™ outline 



First Seminar ^ Organization of Group Practice 

1,1 Entitlement 

1,1*1 EKpectations In the doctor/patient relationship 
1.1*2 Private practice 

il No legal requirement to continue care 
,2 Payment eKpectation not certain 
1,1,3 Prepaid group practice - mechanism to firm up expectations on 
both sides of doctor/patient relationship 

j 

li2 Prepaid Group Practice Organisation 

1.2.1 Diagram ©£ Genesee Valley Group Health Association (GVGHA) 
organisation 

1.2.2 Contractual relationships beto^een Insurer , consumer and pro- 
viders 

ftl Balance of services with premium cost 

,2 High premium costs and the self-def sating spiral of 

rising costs 
,3 The medical group at risk 
.4 Risk forces efficiency 
,5 Internal mechanisms for care delivery 
,6 Insurer's functions (capital, advertising) 
,7 Entitlement ("contracted bene£its'% representation in 

plan operation) 

1.2.3 Distribution of premium Incoma 

1.2.4 Critical enrollment level 



1.3 Medical Foundation Plan 

1.3.1 Diagram of foundation plaii 

1.3.2 Characteristics 

,1 Similar to traditional free enterprise 
,2 Insurer's benefits extended to office care 
' 1,3,3 No controls on costs such as hospitalisation 
1,3*4 Limitations on free market controls 
1»3.5 Illness-'Skewed population and cost overruns 
1,3*6 Risk 

1.4 Rochester Blue Crcis/Hlue Shield 
1.4.1 Membership (85% of population) 

1,4*2 Basic coverage - essentially hospitalization 

1*4*3 Governing board - InduBtry representatives 

1,4*4 Industry - Premiums i hospital costs 

1,4,5 Blue Shield 

,1 Founded by health providers 
,2 Governed primarily by surgeons 
.3 Repayment and specialty interest 
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1.4 Rochester Blue Cross/Elue Shield (Con*d) 

1.4.6 Major mediGal supplements 

1.4.7 Blue Cross/Blue Shield and local govamance 

1.5 Peer review 

1.5.1 Necessary to control quality 

1.5.2 Allows decentralized control 

1.6 Summary ^ 

1,6.1 U*S, health care B% of CNP 
.1 TaK dollars - 30% 

,2 ' Consumer and government objections 
1,6,2' Efficient health care organisation as an answer 



Second Seminar - Flnanelng; of Group Practice 

2.1 Goali Economy of scale allowing self-perpetuation 

2.2 Organization phases 

2.2.1 Preoperational 

2.2.2 Deficit 

2.2.3 Operational 

2.3 Evolution of GVGHA 

2,3*1 Rochester Blue Cross/Blue Shield versus SKcess hospitalization 
,1 Factors encouraging hoipital construction 
,2 Hospitals and increasing health care costs 
,3 Bases for comparison (beds/1000 populationi 
hospital day utilization rate) 

2,3.2 Rochester Blue Cross/Blue Shield and group health alternatives 

2.4 Preoperational phase 

2.4.1 Conmunity study committee 

2.4.2 Preoperational planning 

2.5 Deficit phase 

2,5,1 Boundaries! First patient to self-perpetuation 

2,5*2 Cash reserves necessary 

2.5.3 HMO and the health care coTimunity 

2.5.4 Controlling hospital day utiliEation 

,1 Savings to Blue Cross/Blue ^Shield 

,2 Limiting referrals 

,3 Pressures for hospitalization in private practice 

2.5.5 Costs 

,1 Facilities 

,2 Basic Service Group 

,3 Administration 

,4 Advertising 
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2.6 Operational pha^e 

2.6.1 Definition; Member fees = Expenses 

2.6.2 Critical mass? 30^000 population 

2.6.3 A cross section of population necessary 

2.7 GVGHA and alternative plans 

2.7.1 GVGHA a true HMO 

2.7.2 Maighborhood health centers (NHC) , dependent on federal subsidy 

2.7.3 Medical fouuidation - economically unsound 

2.8 IIMO attrition 

2.8.1 Inadequate funding 

2.8.2 Lack of administrative systems 



Third Seminar ^ Facilities Development 

3.1 Planning Group Health Antoulatory Care Facilities 

3.1.1 Predictions from population statistics 

3.1.2 Maximum population for one center: 30-40 , 000 

3.1.3 Accessibil ity 

3.1.4 Adaptability to unpredicted needs 

3.1.5 Services mandated by law 

3.2 Satellite Expansion 

3.2.1 Regional dispersion 

3.2.2 Primary care staff only 
'3,2,3 Capital accumulation difficult 

3.2,4 Static HMO ^ Population growth -7 Overcrowding -?Decline in care 

3.2.3 Efficiency increases up to 100,000 members 

3.2.6 Projected local sites 

3.2.7 Problems of medical records 

3.2.8 Advance planning and construction avoids overcrowding 

3.2.9 Problem: Wlien stop eKpansion for profit taking? 

3.2.10 Expansion increas,es impact on 'hospitalization 

3.3 Facilities costs - Wilson Center 

3.3.1 Construction - I 3. 2 million - |50/square foot 

,1 90 examination rooms 
,2 Modular design 

,3 Based on Kaiser Portland program 

3.3.2 Operation! Utilities, maintenance, rent 

3.4 HHO and hospital cooperation 

3.4.1 HMO can predict hospitalization rate 

3.4.2 From this toe hospital can plan census and adjust capacity 
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3.5 Costs of Rochdster Health Plan alternatives # 1975-76 
3,5*1 GVGHA - close to basic Blue Croee/Blue Shield 

3.5.2 NHC - siqnif icantly more 

3.5.3 Medical foundation - premium has dQUblad - skewad patient population 

3.5.4 Rife^ft. sharing necessary component of H140 

3.6 Student Questions 

3.6.1 Qi Role of Psychiatrists at GVGim? 

A I Consult and treat psychosomatie as wall as frank psychiatrie 
problems 

3.6.2 Qi Urgant visit mechanism? ■ 

Ki Phone triage by nurse, physician reserved for sme day 
appointments 

3.6.3 Qi Is GVGHA enrolling a younger population than overall 

Blue Cross/Blue Shield? Will costs rise when older 
population admittad? 
A I No, enrollment profile not different. No, 20-^44 age 

bracket use significant nimiber of OB beds. Fifty percent 
of last month's hospitalization OB. 

3.6.4 Pattern in failure to re-enroll? 
hi NOr temination rate less than 1% 

3,6*5 Qi Loss ratio? 

A I Amount used for benefits compared with administrative ^ 
costs - GVGHA loss ratio 94% # objective 96% 



Fourth Seminar - Staffing for Comprehensive Health Services 

4.1 Student knowledge and attitudes regarding health care givers 

4.1.1 What is an optometrist? (Few students knew) 

.1 SpecialiEed in=-depth training 
,2 Comparison with ophthalmologist i optician 
.3 Legal restrictions and professional collusion 
result in underutili^ation 

4.1.2 Restrictions and underutlliEation common among health professions 

,1 EKample - nutritionist ^ at GVGim counsels Md consults 
.2 .Example - nurse clinician (general ignorance among 
students regarding nursing) 

4.1.3 Emphasis - physician ignorance of other care givers 

4.2 Comprehensive health care (CHC) 

4.2.1 Even the best systems have limitations 

4.2.2 Definition - local reso^ces and source of list determine definition 
4.2*3 Need to shift from medical care to health care 

.1 Health insurance deals with "cure" problems 
.2 Most resources needed for "care" problems 

4.2.4 C.H.C.Team - 50% medical, 50% other personnel (care based 
on need, not prerogative) 

4.2.5 Benefits - monitoring of performance and varied inputs 
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4.3 GVGHA staff ©rganiEation 

4.3.1 Executive committee - represents all services, determines 

staff jpolicy 

4.3.2 Physicians share control 

4.3.3 Role determination 

.1 No job descriptions 

.2 Preedom to assume aare roles . ^ 

.3 Regulation by personal responsibility and internal 
accountability 

4 3.4 Flexible system - skills given by as many people as possible 
4.3.5 Emphasis ^physicians will soon be forced to work wxth, 
not a^ve^ other health professionals 

4*4 Physician - Nurse Clinician teams . 

4.4.1 A cofl-e^ulal relationship of peer professionals 
4 4 2 Each provides wilque knowledge and skills 

4*4 ^3 Team example - 55 year old male, uncontrolled hj^erteneive. 
Physician considered raising medication, nurse clinician 
recommended working on home stress and diet before more 
medication. 

4.4.4 Nurse Clinician diagnoses psychosocial aspects of problems 

4.4.5 First patient contact - either physician or nurse 

4.4.6 Niirse clinician as counselor 

.1 Time less eKpenslve than physician's 

[2 One-third less patients for longer periods 

4.4.7 Nurse'cllniclan manages routine problems (e.g. vaginitis, sore 
throat, family planning) 

4 4 8 The patient as part of toe heal^ team 

4.4.9 Nurse clinician capable of 80% routine physician tasks 

4.5 Primary care ^* j ■ 

4.5.1 Diagnoses seldom easy, clean or definitive 

4.5.2 Medical school preparation 

1 Emphasis on e^cplanatlon of every sign and symptom^ 
.2 unrealistic for primary care - can't eHplain everything 

4.5.3 Glinical judgment replaces complete explanations 

,1 Nursing training for primary care ^ 
.2 Long term observation and assessment of critica:! 
factors , 

4.5.4 House officer dependency on technology 

.1 Overuse of lab teats 

.2 High, cost substitute for' analytic thinking 

4.5.5 Prunary care learned by dealing with people 
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4*6 Effeat of staff organisation on oare 

4.6,1 After hours call rata - 30% of other groups 
4*6.2 30% of services from non -physicians 
4*6,3 Per client visits per year ^ 3*91 
4.6.4 Substitution of non-physician services saves 
members nwney 

4.7 Nursing 

4,7*1 Types of nursing education - Midwife / LPN, types), MNP, PNP 
4,7*2 MNP and PNP - Nurse with physical assessment skills 
4*7,3 Primary care nursing - coordination of care for 

eonprehensiveness and continuity 
4*7,4 The legal definition and redefinition of nursing 
4*7,5 The nurse's "right" to practice some skills now 

defined as "medical" 



Fifth Seminar ^ Constmerism and Group Practice 

5.1 Rise of consumerism 

5.1.1 Traditional physician control of health care system 

5.1.2 Lack of consijffiier involvement 
5*1.3 Need for cost containment 

5*1*4 Unification of consumer special interest groups 
5*1.5 Possible physician/consumer relationships 

*1 Cooperative synthesis 

,2 Continued adversaries 

5.2 Consianerism as a aorrective mechanism 

5*2,1 Traditional situation - malpractice suit the only 

corrective fee^ack 
5.2.2 Limitations of free market mechanisms 

,1 "closed" practices 

,2 M.D, shopping discouraged' 

5.3 Problems of consumer education 

5.3.1 Example ^ Yale^New Haven trained coimnunity workers to ,in{om 
members regarding health care and costs 

5.3.2 Informing l^or leaders 

5,3*3 Question, of physician responsibility 
5*3 .4 ReluctanGe of patients t© question 

5.4 The ^nsmner ' s role in health care 

5*4,1 Definition of needs, not means of delivery 

5*4*2 Misapplication of pressure on delivery madhanicms 

5.4.3 Delivery mech^isms tlie professional's responsibility 

5.4.4 "The better the system, the fewer (more appropriate) 

appointments" GVGHA 2*8 physician visits/yeari 1.1 non-physician 
visits/year I nationally 4,5 
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5.5 MalpractiGe 

5*S,1 Lawyers view as quality eontrol meohanism 
5*5.2 Suit frequency and ^ount proportional to resources 
5.5,3 The decline of auto liability and rise of malpractice 
as sources of lawyer income 



Sixth Seminar - Clinical Problems in the Primary Care Setting 

6.1 Differential Diagnosis of Strep Throat (Pharyngitis) 
6.1.1 Signi observed^ objective data 

6*1,2 Symptomi aubjeotive data^ reported by patient 

6,1,3 Examplai typical signs and symptoms of strep throat 

6*1*4 Aspects of fever 1 significance, sites 

6,1*5 Array of possible diagnoses 

6*1*6 Tests useful in dif ferentiationi incl WBC 

6*1*7 Otoer differential signs: livery spleen^ adenopathy 

6.2 Problems of primary care diagnoses and treatment 
6*2*1 Presenting s^ptoms outniai^er signs 

6*2*2 The quest for "objective" datas l^oratory tests Bnd surgery 
6,2.3 Diagnosis and treatoent on the Has is of syit^toms 
*1 Appropriate in andbulatory care 
.2 Reliance on tiim ^dy's healing processes 
6*2*4 "Sequellae of intervention fequently more serious than 
most disease processes" 

*1 Johns Hopkins study i 40% medications given in error 
*2 Strep throats penicillin may be n^re dangerous than 

natural disease process 
.3 .S^ptomatic treatments conservative/ most 
conditions self-lijniting 



Seventh Seminar Mark eating Group Health Insurance 

7.1 Advertising 

7*1*1 Mass media costs 

7,1*2 Alternatives to mass media 

,1 Targeting on-^site presentations to certain populations 
,2 Me^er reco^endations to co-workers 
*3 Open house nights 

7. 1.3 "Service sells # not advertising" Sloan Institute study: 
Peer infornmtion process most important in health care 
decisions 



7.2 Physieian involvement in marketing limited 

7.3 Group health and industry 

7.3,1 Many industries restriet on-site promotion 
7*3,2 Effieiont HHO offers savings for employer i 
7p3.3 Allows employers .to offer a ahoice of benefits 

7.4 NHC and GVGHA - Two health oare plans in eompetition 

7.4.1 Simultaneous marketing confuses eonsimers 

7.4.2 NHC and its advertising designed for inner oity population - 
no threat to suburban physicians 

7.4.3 GVGHA population a cross section of Monroe County 

7.4.4 NHC 

*1 High federal pi^sidy allows ineffioienoy 
,2 Population 5% prepaid - not organised for 

prepaid praotioe 
.3 A federation of independent oenters 
,4 Administrative costs 45% # OTGHA^s 9% 

7.4.5 EJHG a federation of independent oenters 

,1 Duplication of administration 

*2 Eaoh local consnmity group pressed for 

complete services; the^f fore ^ redundancy of 
es^ensive secondary services (inappropriate 
oonsiuner control) 

7.4.6 GVGHA services located in one facility, NHC refers client to 
specialists outside organisation 



Sighth Meeting - Patient Home Visits (Preceptor and three students) 
}*1 Student #1 - Patient, Mr. M,S. 

. Mr. M,S, is a SO^year-old Caucasian male. Diagnosed approxiinately 
four months ago with cancer of the lower GI tract, BKcision of the 
primary lesion and the lower portion of the rectum gave remission 
of symptoms for approximately two months. He was rehospitali^ed two 
weeks ago with extreme lower back pain radiating posteriorly down 
the legs. Preceptor feels tiie prognosis is poor. 
His pain is relieved only by closely regulated large doses of a 
mdrphine derivative in hospital. He seemed in relatively good 
spirits and comfortable with the hospital care. Each student 

, asked questions ateut his spnptoms. 

.2 Student #2 - Patient, Mrs, M,B. 

Mrs, M.B, is a 52-^year-old black female diagnosed with hypertension 
and renal failure within the last month. She has started dialysis 
at RoGhester General and now is dialyMd three times a week. Student 
interviewed the patient for approximately ten minutes, tracing the 
history of her problems over the last ten years. Preceptor palpated 
her ankles and asked several questions regarding her progress. 
Mrs, M*B, vms concerned i^out taking a two week vacation to visit re- 
latives in a southern city* Frecoptor said he would call ahead and 
C arrangements with a hospital for continued dialysis, ^ 
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8.3 Student #3 - Patient, Mr, C* 

Mr* C. is a ST-^ygar-'Old white male with chronie atharoscler otic heart 

disease and a nsurological deficit, probably due to atherosclerosis. 

He ra tired three or fo^ years ago, after a nm^er of minor heart attaoks 

and is now oonfinod to a wheelchair* m. C»s neurological deficit effeots 

his legs and speech. He also has diabetes. Within the last year hie 

wife has suffered a mnor heart attack which required that she be 

hospitalized while Mr* c* was placed in a nursing home. 

i^ile at the nursing bLome for three of four weeks a therapist 

succaaded in reantoulating him to some extant* Preceptor is 

concerned toat he continue to walk as much as possible. The student 

asked several questions regarding to* C's condition and medication, 

8.4 Assigmnanti Following visits with all patients, preceptor 
assigned studants to study their chart and construct a history 
of thair illnesses, 

8.5 Studant Corraients 

8*5.1 Preceptor ",.is evidence contradicting those who say that 
internal madicine and primary care are not challenging 
fields." 

8.5.2 The studant amplified, saying that his parents and others 
in his family es^act hiln- ta'baaome a specialist, and he 
has argued the value and challanga of primary care as a 
field . 

8.5*3 Other students have also axprassed increased understanding of 
the challenges offered by internal medicine and primary care. 



Ninth Meeting - Primary Care Task Force Reports (Medical Center 
Recall Session) ^ 

9.1 Metropolitan Hospital Group Practice 

9.1.1 Patient contact machanism ^ 

,1 Studants make first contact by phone 
.2 Interview times difficult to arrange 
♦3 Patients suspicious of medical students' motives 
*4 Student frustration - "Problems could have been avoided 
by preceptor contact" 

9.1.2 Contact with health care professionals (HCP) 

.1 No continuous contact 

,2 wide range of differant H^C.P.'s 

9.2 Urban FMiily Practice Group 

9.2.1 Patient contact 

.1 A patient assigned to each student 

,2 Minimim of one home visit 

,3 "Overall little patient contact" 

.4 Elementary school mental health screwing 

9.2.2 H.CP* Contact 
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9.3 Inner-City HealUi Center 

9,3*1 Patient contact - limited to ©bierving one patient in the • 

system. Will not be assigned a patient. 
9,3,2 H.C.P, Contact 

.1 Atoinistrators 

.2 Commimity Services 

.3 Pnblic healto nurse - Difficult to arrange meeting 

9.4 Basidential Neighborhood Health Center 

9,4 p1 Patient contact - soon to be aseigned 

9.4,2 H.CP* contact - continuous experience with a physician 
9*4,3 A few small research projects begun 

9.5 GVGHA 

9.5.1 Patiant contact ^ patients assigned to individuals. 
Many contacts already made. Preceptors involved. ■ 

9.5.2 H.CP. contact ^ Continuous contact with physician preceptor 
plus interviews with range ©f H.C.P.'s 



Tenth Seminar - Planning Student Clinical Presentations 
10.1 Assignments 

Student # Patient Patient Problem 

1 Mr. M.S. Ca colon, terminal 

2 Mrs, H.B. Renal failure 

3 Mr, C. Chronic acherosclerosis with neurologic 

complications 

4 Mrs. E,W, Ca breast i spinal metastases 

5 Mr. F.U. Minor CTA 

6 H. Post--second CVA# chronic emphysema 

7 J,F. Ten-month old, developmen tally retarded 
8 

9 D*F, light-year old with nephrotic syndrome 

10 A.S, Pour-year old, mild mental retardation 

11 W.D. Adolescent, Sydenham's Chorea 

12 T.V. Twenty "month old, spina bifida 
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10.2 Presentation format 

10.2.1 Briefly prosant the clinical entity j , ' - 

10.2.2 SummariEe identifying data relevant to patient and famly, 
including age and family constellation 

• 10 2 3 Present a brief history of the clinical problem, including 
sequential onset, high points of course, present status 

10.2.4 Characterize the health care parsonnel involved 

10.2.5 Make prognosis 

10.2.6 Length - 5 to 7 minutes 

10.3 Student comments ^ ,,4=4 4.= 

10.3.1 student #3 = patient 's wife refuses further visits. , 

Preceptor I "Aware of situation, respect wishes, unavoidable 

10.3.2 Many students stressed they are more at ease with patients 
toan at beginning of semester. _i 
preceptor I "Has seen great increase in overt confidence 

10.3.3 Concern was esqjressed regarding taking more from patients 
than able to give. ^ j . 
Preceptors Students are benefitting patients by giving 

them attention . , 

10.3.4 Some minor frustration estpressed over feeling unprepared 
to interview and examine 



Eleventh Seminar - Student Clinical Presentatio ns 

Note : Presentations of students 1, 2, and 3 not recorded due to 
observer absence. Refer to eighth meeting (home visits) 
for description of patients . 

Twelfth seminar - Student Clini cal Presentations. 

12 1 Student #7 - The patient, J.F., is a one-year-old male born nine 

Seakspremature. His present condition is diagnosed as developmentally 
^^tarded! This situation. is probably due to frequent apnea during the 
five weeks in which he was hospitalized post-partum. J.P.'s mother 
estimates that he must have stopped brathing at least fifty times 
in the hospital and at home. On at least two of these occasions, toe 
oxygen deprivation was severe. The symptoms of retardation were first 
apparent when J.F.'s head growth accelerated rapidly. He has since 
Sfn diagnosed as having a motor skills deficit and f =f°-«^^|°-f 
on a Denver developmental test. It is the °P^"i°" 

^^nrnlooist Called in on consult that tliere is brain damage. J.F. is 
no^in a eourse of rehab training at the Monroe Developmental Center. 
Tt contracted viral pneumonia two months ago but is well now. His 
^t^er had a miscarriage one month before she became pregnant wito 
a r The student commented on the management of this patient. He 
f'Al it was generally good, that J.F. and his mother received a lot 
of emotional support from the GVGHA PNP., , The student visited the 
^ati^nt at home', four times at the Wilson Center, ^d once at strong 
Sen«rial. sitting in with the pediatric neurologist. 



12,2 Student #9 - The pationt^is a sin and one half year old boy, p*F. 
His condition, idiopathic nephritis, was diagnosed by the 
procQptor approximately one year ago. It is now reasonably well 
con trolled by diet and drug therapy, but the patient now has a 
lowerad resistance to disease. When ha is ill, the protenuria reeurs. 
At this point in time the Illness has recurred, but the overall prognosis 
is reasonably good for children. The preceptor noted that there was 
some eorrelation between parents with allergies and children wiUi 
nephrotic syndrome. Both patient and nother are compliant and 
conscientious, ,The' mother ' s medicaj history is interesting. Ohe has 
had many medical problems, Ob/Gyn problems, headaches, and emotional 
problems. The student observed that there is very little conTOunioation 
between the mother and father. The mother seems inclined to hysterical 
revealing of her problems, as exemplified by the speed and detail with 
which she presented them to the student on her first interview, in 
addition, her memory of sequences of events is poor. The student com- 
mented that the management of this case was good, and the prognosis 
reason^ly good, i.e., 70% of children with this condition do recover. 
The preceptor reviewed the diagnostic criteria wj th the student and 
discussed what drugs were used in therapy, dosage and side effects. 
The preceptor complimented the student on observing that, "as usual, 
the illness involves more than organs - control of the social environ- 
ment is a greater challenge than the kitoeys," 

Student #4 - The patient, Mrs. E.W,, is a 71 year old woman with 
recurrent metasteses. Mrs. E.W. had a radical right mastectomy 
in 1968. A recurrence of metastases in 1970 was treated with 
cobalt therapy. Her long history of arthritis in^ ^tdie spine makes 
it difficult to diagnose metastases. In October, 1973, she came to 
the preceptor. It was the first time she had had a regular internist. 
In Noven^er, 1973, metasteses were found, and she was treated with 
radiotherapy. In February of 1974, she had aeriohypophyBectomy. This may 
or may not have helped, but has relieved her pain. The edema in her 
right arm has worsened^ so she is now taking diuretics. These are 
not helping as much as they should, so there may be a tmnor involved 
there, Mrs, E.W, is on several drugs including demarol, which she 
resists taking. She maintains detailed redords of all aspects of her 
problems, probably due to her training as a nurse. The student made 
only one visit with the patient, does not know the prognosis or other 
sources of support for her care. He did not comment on the management 
of the patient. 

12.4 Stuaent #5 The patient is a 49 year old, white, male, Mr, P,U*, 
diagnosed with mild atherosclerosis, high cholesterol and 
triglyceride levels following an attack of angina pectoris while 
walking to work, Mr. F.u.'s first visit to the preceptor was 
his first physician visit in ten years. He was treated with 
vasodilators. The student noted that the patient was somewhat 
I confused over his medication regiment, thinking that he need only take 

^ his medication when pain occurred, when really the preceptor had 

prescribed it on a regular basis, 
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Thirteenth Seminar - student Clinical Presentations (5/19/75) 

13*1 Student #11 The patient is a fourteen year old female^ W.D,, who 

developed neurologic probleros subsequent to several strep infections* 
The patient presented complaining of emotional lability # slurred 
speech^ and nervousness. She exhibited signs of fidgeting , deoline 
in fine motor capabilities^ depressions physical eKamination revealed 
a slight heart murmur* The preceptor provisionally diagnosed post 
streptococcal chorea. She was admitted to Strong for a cardiac 
consult regarding thm possibility of rheumatic fever. She was 
finally diagnosed as having Sydenham's Chorea^ popularly known as 
St. Vitus' Dance. The student made two home visits with the 
preceptor, WpD.'s symptoms have vaalllated for several months* 
tiierefore^one of the biggest problems in her management was tjie 
question of her going back to school. The preceptor and the parents 
decided that it was best that she be tutored at home. This was 
arranged with the school district. There is a possibility that 
W.D, may have mild heart dM\age, but her progress has been such that 
the preceptor eKpects she will be free of aynptoms by suamer and should 
return to school next year. 

13.2 Student #10 - The patient is A.S.# a four-year old male diagnosed with 
mild mental retardation of mknovm etiology. His mental age is 
approximately two and One half 'years. His younger brother is also 
retarded and died at age twelve months of an unrelated cause. The 
retardation was diagnosed early. The child now attends a home care 
training program at the Rehabilitation Center ^ as well as a day care 
center near his home. The child currently has coranimication problems 
in that he can imderstand what people are saying to him, but is imable 
to return the commimication . The student visited the- Rehab Center 
with the patient. He detailed the large nun^er of specialists involved 
in the care of a case like this, including a physical therapist, 
audiologist, specialist in activities of daily living, and morep 

A.S.*s parents are highly educated. They take good care of him. However 
they want to terminate therapy and keep him in the nursery school where 
he is now. Although he is doing well, the health care professionals are 
uncertain as to whether or not he can handle the environment as a sole 
source of therapy. The prognosis is uncertain^ since his condition's 
etiology is unknown. Another student challenged the validity of the 
psyoho logical evaluation. The presenting student defended it# es^laining 
the si^jective aspects of this evaluation were as important as the more 
objective tests. 

13.3 Student #12 - The patient is T.V,# a 20 month old male who has spina 
bifida. His condition has resulted in incontinence i paralysis 
below the waist, and hydrocephalus.. In addition, his social 
situation is quite unstable,- T.V.'s parents were unwed at the time 
of his birth, the father unemployed and apparently a petty criminal. 
T.V**s delivery was difficult, probably due to a lack of prenatal 
care. He is slightly mentally retarded, but can feed himself. The 
student described spina bifida, its process, research, statistics 
of occurrence, complications, and treatment. He then described the 
social history in more datail. He described the large nw^er of health 
care personnel Involved, a very compleK mMiagement problem. 



STUDENT INTERVIMS WITH 
GVGHA DEPARmmT CHIEFS 



L*0 Buiiness Office . 

1.1 Objective I Systematic Recovery of Patient Ixpenditures 

1.2 Patient management form 

1,2,1 Baaed on Kaiser Permanente 
1.2 *a A CQmplete record for each patient visit 
1,2,3 Form infomation including billing type, service 
used/ fee deviations 



lp3 Insurer claim processing 

1.4 Referral mechanism * 
1*4.1 Referrals costly 

1,4,2 Director, Business Manager approval required for 
reimbursement 

1*5 Out-of-town claims paid 

1*6 Member screening 

1,6.1 Reserve right to refuse mer^ership 
1*6.2 As yet no attempt to screen 

1,7 Other activities 

1,7.1 Reception and patient routing center 
1*7.2 Membership information 



1*8 Problems 

l.S.l The business office is point of conta^ct between the group 
and the insurer* Therefore, it is often the site of 
inter-organizational conflicts 
1*8,2 Development of computerized billing 
1*8,3 Pee for service billing - diversity of third party 
sourees# partial repa^ent schedules 
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Pharmaey * , 

2.1 Patient education 

2il.l Individual drug use profile 

2,1*2 Counaellng on daeaga and aide ef feces 

2*2 Drug pricing - 

2.2,1. Negessity of being eompetitive 
i,^ 2^^2*2 Cost plus sliding fee meohaniem / 

2,2*3 Substitution of generio drugs elimlnatas duplication, 
allows large lot r wholesale buying (physician waiver 
required by law) 

2.3 Formulary ^ listing of drugs the medieal group oonsidere 
necessary for practice - eliroinatas unneee^sary inventory 

2p4 Undsrutili^ation of pharmacists 

2*5 CliniQal pharinaoy \ ^ 

2*5,1 Consultation with group physicians on pharmadological 
problems 

2.5*2 Emphasis on clinical work beyond the pharmaoy 

2.5.3 Training I more biochemistry, physiolo^ and pharmaoology 

than traditional "druggist" program 
2*5.4 Pharm.D. (Dootor of Pharmaay) New degree # new role ^ not 

yet wideiy aooepted in medical oenters* 



Internal Medicine Seotlon ^ ' 

3.1 Patient J*R.| 79 year old| fenale, routine check 
3*1.1 Chronie di^etea and h>Tpertenaion 

3,1*2 Blood pressure elevated - failure to take medicine 
3,2.3. Preoeptor suggested arrangements to help patient 
get medicine ^, 

3.2 Patient A.S*# SO year old, female , first visit 

3,2*1 Recurrance of hiatal hernia « irritated by nervousness, 

roughage , 
3.2*2 Personal and family history 

3,2*3 Drug history - patient asked for refill of old 

presoription preceptor checked PDRr refilled but 

advised limited use. 
3,2.4 Preceptor advised scheduling for complete physical - 

diagnostic tests, consultation with nutritionist and 

eHerclse 



165 



i^r^y:- .■ ■ ■ . ■ ■ ■ 

?i:;4,0 pptometrist 



4.1 Patient E.M., 65 year old female domplainijig ©f bliirred vision 
4,1*1 Complete visual eKams ©phthaln^acopei aauity, aatip^tiim 
4.1.2 AssessTOnt of family hietory, physiGal eonditioni 

past health 

4,1.3 ' Tinnometer - glauooma test. Showed possible pressure 
elevation i Patient asked to return in one week for 
seoond test, ' 

4.1.4 ^tometrist altered bifooal prescription 

4.2 Patient ^•W., 68 year old xmlm complaining of cKoessive tearing 

4.2.1 Conplete visual examination and assessment 

4.2.2 No abnormality foimd - slight change in preseription 
- and replacement of badly soratehed lens. 

,4,3 Patient H,N, I 17 year old male - urgent visit for apparent 
allergic reaction 

4*3.1 ExMiination witii slit lanp revealed no ^normality 

other than obvious irritation 
4,3,2 Reaction had occiitred previously ^ optometrist 

agreed wiUi patient diagnosis, prescribed ointment 

for symptomatic relief 



5,0 Communications Center 

5.1 Patient appointment system 

5.2 Types of patient calls 

5.3 Defining patient needs 

5.4 Urgant visit triage by nurse 

6,0 K-Ray * . • 

6.1 K-Ray record system - access and periodic retesting 

6.2 Equipment - purposes, techniques , safety 
6*3 Automatic processing of films 

6,4 Interview with radiologiet (diagnoeis of colon poljTp) 



0 Other Rotations • ' ' 

7.1 Rotations in pediatrics, Ob/Oyn, Urgent Visit Clinic, 

Laboratary Services and Medical Records woro not observed. 
Q Uowevori all rotations were attondod by all studente, 
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^COMIffiNDED READINGS 



OrgajiiEation of Group Praatiae 

1.1 "Develojpment of a Prapaid Group Practice Plan (HTO) in a 

24 month Period in a Metropolitan Comnunlty^ " Dr. Harold Gartoer 

1.2 "Health Maintenances It Works," Shiela K, Johnson* ( New Ifork / 
Times Magazine ) . 

1.3 "General Medical Care, identification and Analysis of Altematlve ^ 
Approaches" by Walsh McDeraott, M*D* 

1.4 "A Medical SQciaty-Sponsored Comprehensive Medical Care Plan," 
by Richara Sasidy and Carl E. Hopkins , Medical Cars , Vol V, No 4, 
July-August, 1967, 

1.5 "PiRO and HMD - Borne Dimensions of Quality," by Emest Saward, GHAA, 
Octrtser, 1974 • 

1.6 "Prepaid Group Practice and toe Delivery of Mtoulato^ Care," 
New England Journal , August, 1974, 

1.7 "This is Prepaid Group Practice Medical Care," by J. A* Prussin, 
Hadical Group Management Association, 1972. 

1.8 "Ohe Role of Prepaid Group Practice. in Relieving the Medical 
Care Crisis," Harvard Law Review , Vol 84, No 4, 1971. 

1.9 "^e Organisation of Medical Care," Irneat Saward, Scientific 
Aznerican , New York, Septenraer, 1973* 

1.10 "Recruitment of Physicians and Organization of the Medical Group," 

1.11 "Prepaid Group Practice: Its Gomponents and Wieir interrelationships," 
by Jeffrey A. Prussin. 

Financing of Group Practice ^ 

2.1 "Some Information Descriptive of a Successfully Operating HMO," 
by Ernest Saward, Janet Blank, and Hen^ Apartment of HEW, 
HMO Service, 

2.2 "Heal to Maintenance Organiisation , Financing Problems," by Avram Yedida, 
speech presented at M^IC Southeastern Regional Workshop on HMO's, 
University of Norto Carolina, Chapel Hill, Feb* 15, 1972, 

•2.3 "Health Maintenance Organisations i Some OrganiMtional and Financial 
Models," by Jeffery A, Prussin^ ^ 

Facilities Developmont 

3.1 "Planning and implemehtation of the Community Health Poimdation of 
Cleveland, Ohio," by Avram Yedida, U.S, Dept* of HEW, 1969, 

3.2 "A Viable Healtli Center for an HMO," by James L* DaJ^ng, March 20, 1972. 

3.3 "Factors to be Coneidered in HMO Site Selection" by Jeffery A. Prussin, 
SeptembGri 1973. 



167 



- St' 



,0 Compreheneive Health Services 

4 pi "Physician Assistants at Kaiser: Distinctive Patterns of 

Praatice"by Paul Lairson, Jane Cassels Reaord and Ji^ia James. 
Paper given at APKA annual meeting, Atlantic City, New Jersey, 
11/14/72, 

4,2 "Nurse Practitioners in Primary Care," by Walter 0* SpitEsr and 
Dorothy Kergin. CMA Journal , Vol 108, 4/21/73* 

*0 Consumerism in Group Practice 

5.1 "Consumerism Health Care," by Samuel Wolfe, P\^lic Admniatration 
Review , Septeiri^er, 1971. 

5.2 Consumer Incentives for He^th Cars , edited by Selma MuelAinip 
Prodeat Publisher, New York, 1974, 
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Resource Paper No. 4 



University of Penneylvania. 
CURRICULUM MODULES! RATIOmE, OBJICTIVES, METHODS AOT PREREQUISITES 

Module Ap Priiaary and Comprehensive Care 
Module B. nie Health Care Tern 
Module C. Conaumer Partleipation 

Module D» Quality of Care 

Module E* EconomicB of WLOb 

Module F. Change and Innovation 
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A, Module 1: Primary Care/CCTqjrehensive Care 

..... . .... ...... . :. .. 

Rationala 

With the rapid mwement in the 1950 *s and 1960 away 
from general practice to specialty practice, tfiere has de- 
veloped a corollaxy cmceiti for tiie maimer in whidi a patient 
makes his initial contact with a provider of care. Priinary. 
care encOTpasses the professioral and relate services ad^ 
ministered by physiciMS Cintemist^ family practitioner, 
obstetrician-gynecologist, or pediatrician), nurse practi- 
tioners, dentists, spcial workers, and other health prof as* 
sionals in an ambulatory setting, with referral to specialists 
as necessary, COTprehensive care invokes the concept of a 
broad spectnmi of health services, tocludlng physicians* 
services and hospitalization whi^ may be required not only 
to maintain health but to diapiose and treat physical and 
psychosocial illness. For th# student COTtfflplating tiie 
choice of a specific career wittin medlcijie, the^iportance 
of this section lies in his ^sportunity to e^^lore alterna- 
tive modes of senring patients witii a concern for the implica- 
tions these choices carry for both "^e providers of health 
care and for the patient • 
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ectlves 

, The UadzYit should fae abU to lUt alt 

Seven on opm'mdkd qmi^tlon on^k^ 

to itatt jjotCaWna ^aWoM 
deve£opm£JtC 0^ HMOU* 

Ji oMkzd about 0iz dUt/Uhatlon oi health 
004^, 4tudmt MouM bt abJU to AMiaM^ 
tii^ nmg^ oi pattmt/fW dU^tJUb^u^ 

OvQMp^ctaiMzatA.dn a icuitoK 

oi phjoi^X 4fca^g 

pfUvat^ pnacM^a^, fee ^fiaa£d 6e do 4 o * 

The student ^houZd 6e a6£e oMwe^ quji&twri4 
on tho. U.S. aommjbnmt to kmUh aoAt d^Us^gJt^ 
u^lng aompaJtjattm n^MAMJL ^Kom o^eA mZLonal 
systeM* 

The 6twdmt should be obie <o rfe^ne p^^tur^ c4^, 
tncltJudLng ifee ^o^fcw^g etemen^* 

A ^eo^cm 0^ pfujtMy aoA^ 4^ that Zt 44 ^e 
yMt po4M oi mtny 4Mo tha. hmUk qjoml 
6ystm, l.€* , ^iMt aoyitact m^cunt* 

Tfie pHtmaJt^ h^aith aoAt pKOvldvi a64ume6 
m^poMAblUty io^ tnt^gnjtjM,ng po^en^U 
htcdUh cMz. 

Int^ghotu JMo pa^eniU hzalth ^lo^tond 
opW.0^ md plam oi ^p^cAMAM^ ^^^^t^^ 
pa^mt l& HJiiViM.d 

VOm 04 sykttm to iauJUfyitt 6y4^tmatla 
ca/te ^OK \jM4zd pKobltn^ 

Comum.Q^u thi. AMiomation to tht patient 

ApplLu alt IniomcM^on to th^ patLmt 

Tht p/Unmy ca/tz p^os^ld^ U Jmpom4bt^ ioK tho. 
aont4nuAXy oi ^e patl^r^^A aompKohoMlm 
htaWi aoAji oue4 *cme. 
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06 feed io dfeAoMfee the. ^€c^imu oi a o^ompm- 

Toi4£ ca4a ^ fceolife and dUstaiz 
HtaJM mauitmmae. 4een M an ^m- 

P^euenAcon and ea^^ cteteeficon 

La6 eo^tCy 4 opening. 

To AMvotve. potent 016 on ac^ye 
/te6pan4-46£e paHttoMpant (hU 
ftea£tft ea^ pKOQHam 

To 4jtioHm peM.e.iftt oi behavd^o^ ihat 
utLtt ma364mtEe kgai^ status 

A66mz At^pomM^AMJiy ^o^ pattmt-s co^e 
thjwaghoij^ sub^systoM 0^ aomp4£/ien4^ue 
p/LogMm 

A64uin£ /LiMpons4Jb4JAty ifo/t p^4eni-4 

Spea4a£46^ HjiivihMM whm 4jfidLaatz.d 

On aoJtJL aovgAage. 24 hovm a dcuy^ 
7 douys a taeefe 

Pwy^^on4 io^ t/iAatmmt 4n an 
m^^may setting MhgJtAvm and 
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PkyAlcMly loac^^d ioK pQpuJt^on\ 
iehvo^d by iy4^m 

oi poptJ^MMon ih/Loagh yM^oM paymnt 

pKOQWlM 

P/LOuldiM ijoko a/Lt to thz vaAjy-: 

To tht aoMmmA. 
To tht pwiu^lon 

To goveAnmmt agmaiu wheM theAo. ^& 
^uppont ioK pHjogkam, aaaounic^l^ io^ 
qtmMtyp qmZi^ oi aoAM. 

Tkt ^tiidmZ should fae able to lUt th^ iypu oi 
pHjoj^JMomu mho dM.yJM pHJjnany h^aWi aa/Lz 

fanUZy p^aotc^oww 

IrttwiUt 

Ob^t^t^o^-gynmotogUt ^ 
UuMg pmatiM^onQA 

Men*a£ htaJUk m^vi^ e.g*, hocMalMo^Vi on. 
0yahMatnM6t 

A6 a JLUiM oi kU aotcu^w at m HtAO, th^ phy4^lUm 

4M tnAUiLng should oHA.^nt hU co^ew. ptmh toi^Mds 

oppoHtimLtLiM to do aotrpfLeJia^4.m cMe* 

Tht studtnt should dtv^lop cl posltiy^ c^tAXud^ 
tMoAd -t/ie pH^ vision o^ aomp^ektiUlvi. coAe to 
patlQ.nt^ 
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Tfee 4iuden< should vaZm 0iom p^iuso/u Mho 
oi HM txp^nA.tnQM.- 
Tht^tud^if^ ^houZd mQoM aontaot me^^ine, 
and ifee oppoHtunLty ^ p/tov^dt aontlniMjig amtp a& 
a 6tirnuJLat<jig way to p^e^ee 

OppohtwfU^ ioK gzniJLUi^ pos^tim 4MeAvmtion 
JUi^ pa^mt ' 
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Prarequisites 

Hie student should have been es^osad to tiie intro- 
ductory matarial In ID 103 before entering tiie sequence iji 
the clinic. I£ not^ listening to the Hertz cassette is the 
miniimm requirement* 

Inportant here will be references from the literature 
on cOTprehenslve screening md on tte concept of healtii 
maintenmce as contra ted wltii crisis TOdicine. 
Learning E^qperimces • 

The section concerned witii.tiie factora under lying the 
develc^ment of WC*s will involve mainly didactic material. 
Method for deliveiy of currlculimi will include assipied 
bibliographic material follcwed by discission of approxi- 
mately one hour* Hie staff resource person is Dr. Klaus, 
Other resources avail^le include reading material and 
specific sections from ^e taped lectures by Dr. Hertz. 

Key tq)ics to be covered in these activities m^t 
include : 

1. Patient -IC distribution 
2* Ovewpecialization 
3* Profit motive 

4. Conparlson of our system witii otiier national 
systenB 

Dr* Kobb has major respoMibility for tiie students* 
unders tiding of thm process by whidi the patient finds his 
entiy into the system* The activity here will be obsewation. 
A student can work with a provider md note different w^s 
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o£ entiy into the system^ such as the episodic visit and 
initial conpreher^ive examination* Here the clerk should 
zJtiB assigned to a provider for one day. Near tiie end of tiie 
day tiiere will be some discussion of concepts to be elicited 
from ^e observation. 

Special attention will be directed to the POI^ as a 
mems to facilitate general patient care. Resources include 
the booklet on POM| tiie Hertz cassette, snd discussion witii 
the provl^r to observe how Pami-Urt records are kept and how 
the POKR len^ itself to a team approadi. toe activity will 
be to conpare standard clinic records taken over from Graduate 
Hospital with PONR at Peim-Urt. 

Aspects of conpreheMive care will be treated first 
throu^ observation, followed by student participation in 
three conplete conpreheMive examination* The student will 
Start with the initial screming, move to the ^ysical exani- 
natiOT, and then obsenre disaj^sion by the tean of the forma- 
tion of a treatment plan* Sdieduling should be so arranged 
that different types of patients will be seen; for exanple, 
an older patient witii nwltiple pr^lems , a yomger patient 
in a sltuaticm requiring patient eiacatim, a pediatric casei 
etc* Qiecklists of* points they are to observe will be developed 
and students will be scheduled in a nanner to allcw them to 
follow a provider mitil ^e diecklist is filled out* 

Teaching the section m continuity of care will involve 
relatively little didactic mterial. Here we will use Uie 



device of havuig the student on call for 24 hour periods to 
answer incoming messages and work in consort.witii a provider 
to develop appropriate responses. It is hoped this will 
serve to fulfill tiie goals o£ gener^ familiarity wltii tiie 
system and specific differentiation of tiie kinds of calls 
received and tiie outcoMS with tiie focus on continuily. One 
tedmique here mi^t be a requirenBnt to make and use a log. 
Some time will also be spent in tiie Graimte Hospital emer- 
gencf room. The puipose here is to Illustrate "Qie^ objective 
in developing continuity of care of using tiie emergenQf room 
as infrequoitly as possible, mly as a necessaty backi^. The 
student will, in this cmtext, make roimds with a provider 
carrying a sufficient case load in tiie hospital. The imit on 
continuity of care will r^uire a review of the system of 
specialist referrals. Sudi referrals are made a nuntoer of 
times during the week, offering opportunities for student 
observation. 

An exercise In ^e review of demographic data will 
serve as an introduction to tiie issue of accessibility of 
care. Here tiie student will be actively involved In developin 
information on where tiie patients live, what tiielr socio- 
economic levels are, age factors, and other varl^les that 
relate to and affect the access to vatying levels of healtii 
care. In the affective area, the student should also be sxh- 
mitted to situations that will sensitize him to the varying 
social needs of the patient. 
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* 

As an introduction to accoimtability, student will 
attend a consumer coimcil meetuig* He will then be required 
to audit several diarts to develop a clear mderetanding of 
h(M these precedures are developed, A dieck list will be 
developed as a medianism to alert studrnts as to what they are 
looking for in the midlts* Finally ^ broader questimsi, sudi 
as aecoinit^illty to govemment agencies , will be covered m 
a didactic inanner. 
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B. Module 2: The Health Care Team: Roles and 
Responsibilities of Different 
Health Care Practitioners in a 
Primary Health Care Team 

Rationale 

With the advent of specialization, medicine has wit- 
nessed a phenomenon not unlike many enterprises that 
emerged througjiout the industrial revolution. As operations 
in these conplex enterprises have endeavored to respond to 
various needs of a mass urban society, differentiation of 
functions and roles has taken place. This has been true 
of medicine as well. The manner in which these different 
functions are integrated remains an inportant issue, since 
it has too often been left to the patient. The development 
of the health care team is one response to this issue, but 
its successful operation depends on the development of 
proper understanding of the in55ortance of each of the various 
contributing roles to the health of the consumer. Here tiie 
student can explore, throu^ direct observation, some of the 
problems and prospects of a team setting. 
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Objectives in the Cofflltive Ddmaln 

.** Thz studtnt shouZd fae able, to d^cjUmincutt mong the. 

Kolu and HM^poyUi^JJUJUM h^Mk aoAt phactA^oneM 

md 6h.ouZd 6e afa£e to iititLzz th€ aompgtm^u o£ moh 

pn^LoZUxontK appkop^Uatzly ^ 

Tht ^tudtnt 6hoaZd be abl^ to define ifte Num^ 
VnaoZlMonejL (WP) 

VaJLLnmZLon o^ o^xpandtd /lotz oi the. nu^e 

A^eod Off aompztenat 

tndzpznd^nt and dtpmdznt ^mctton^ 

Aaaoim^^ttUy 

VtvLhton o£ AMpoMtbjiJLLty wtth otheA p^eii- 
^oneM 

Hou) the NuMt F/La^M^dneA. A.nt2/La^ w^th otiteA 
h^aJUh p/w^^6toncLU 

Vhy6l^an~HuMt PmctttLonoA tntM/icMom 

NuMt PULcMtloMA 04 a member o^ a Ioaq^k tdcufn, 
e*g*^ NuM^ PmatttioneA'Phy^t^ian-SocZaZ Won^ 

Hojo Nauz pJw.atLtion2Ji ^nteAacM mXk patltnt 

Hzc^Xh ^dmatton a6 m Impon^ant pant oi tht 
UuMt PhactAMoneA^ ^ «£e 

Long t2Am managmtrU: oi chwriia 4JtZnU4i 

Vtagno6^ md tAiatmmt oi maompJLLa£^td acutz 
di6e.a6t tn accoKdanae. vo^M. p/wtoaoi^ 

PamLZy oA^znttd htoLth cMA ba^o^d on a knouote^dgz 
oi iamtZy dynamiQ^, hzatth bekavto/t 

SuppQHZLvQ. Kolz aoimseZuig, nuMu^ng md ca/Ung 
OAt 4jnpoMMnt AkJXU am KtpQAtoVie oi ifee HuMt 
P/ta^itioneA 
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Tht Student should be ab£e to du^uht km 

to thz wo^fe netting 

NuM€ pmc^az vohIqm maoKdlng to htaZth aoAJi 
siting 

family nu/ue cJUmI^cui, (dJ^nlaaZ nu/i6e 
6pzcU.aiMt 

r/te 6tudtnt should 6e a6£e £o de^^e die SouM Wohkm 

VgMon voho mn.kh ioK pohltLvt eitange a;.t^i^n 
tn^vtduaZh and gwups 

He£)^ peA60n dAAaoveA om Auou/iau 

Tkz studtnt hhould be ablo. to aZLJUzt thz SoalcLt 
Wonk^A appKophlatgXj^ In a ^ea£tfe co^e sattiMg 
waMi tkt knovolzdgt tk^ tht Social Wo^m has tk^ 
^oiZouotng aompeXmat&s md o^tyitation 

Psycho to gtaaJt tmc^znt o^ sick ptoplt 

Emphas^ on stKmg^^ tndLvtduaZ possassu ^ 
/uxtheA ^an on u)mknU6 ok tIZnu6 

FunatioyiS to help poteen^ ^md coping 
6tJmtQ.gtas ^o^ auAAmt phystaal and psycho- 
logtaaZ pKobZ^m 

FacM^tatoJL oi tnoAtaszd mmmeMs oi zaoijogy 
oi pcM^e^nt, the, pati^yU cub a i^holt poMMon 

Ln toAM oi hL& psychoZogtaaZ ayid socto-zcjonomia 
(Lonttxt 

Stnjus on JjfnpoHtmc.a, psydLologiaaZ £a^m 
vohlch yotU. heZp oK htndeA patitntU hzoMh 
moAjfitmajfiaz 

Comm^znt to matM-phjoius tonal, mulM-spt^aiZy 
tmtn appAoaah to he^alth cam smvia^ 

¥aQAlttatoK 0^ sta^^ compeienae at mee^ng 
psycho-social n^zds o^ Sie. pa^mt 

Comp^tmcQ. mMi Indlvldbal and ^amUy o^eMtd 
aounsgUng 
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Tht Student should 6e obit to txplaln tht ioMv^u 
oi tkt Kott oi thz pkyS4.^an in an HMO 4 eating 

We shoLLtd fae ajfa£e de^^ne va/Uou^ mod^U 

Mtd^di^clpJtLnaAy guap p^^ocicae mode£ 

VamUjj p/LOLcMi^on^A modzJt 

Tht studtnt hhouZd fae ahlz to dmoyutAotz that ht 
md^tandh hou) an o^gayUztd i^y&t&m oi htaJUh 
daZLveAy impact6 upon rmdLcjaZ p^aottae oi ^e 
physJ^cuMi 

Ht 6ho\j^d fae ahlt to exp^ocn ^fie wc^h In (^kLch 
tahfu oAz dLvtdzd aaco^tittng to the. p^ne^p£e 
^at mch memfaw thz tzcm pnnvMdu to thz 
paJJ^mt tht typz oi htoMk aa/it fie ^ but p^e- 
paJizd to dgiA\)tK 

Whm tilt 6tudtnt aoni^nttd a potent, 
ht shouZd choost to wo^fe ooopew^ue^ and 
aolltgtaMy 

Tht 6tudznt should choose, to mnh wAXh otii2A. 
6ptCA.€UMt6 a/LOund iamHy hgaJUh co/te 

He should mofee u^e oi tii^ za^y oeee^-A to 
aoiJLzagm4 dA^cu^ston oi tH.eatmnt 
stmtzglu md tilt dtvtijopmQMt oi htaitii 
aoAt pojLLqa.z6 

BekavioKot txamplu 

Managmtni oi chHjoyiLa dUza^tf e.g*, 
d^abzteJi, Ae NuJUt PmcMttomA tdacMtu 
potceai md managu t/Ltatinznt 

SoaiaJL 6iAvtat aomponznt b/LLn§6 4pee4^e 
p/wi2^S4.onat txptHtJMt i^kidi bwadmh 
imdiMtandLng oi patltnt 

Tht 6tLideM should fae ablt to lUt tiit methodh 
thHough ijokidi tkt qiwM^ oi htaWi ca/Lt can 
fae mon^ohtd on HMO 

PeeA /LtvZm) 

InteJtnaZ audit 

ExttmaZ pHniu^lonaZ m.vMm 
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Thz Atudgy^ 6houZd fae ahlo. to lUt th2. ^oHmlng 

Nm mphml^ on he.aWi mlntmantt and p/L£ve>^on 
06 tjoztt 06 cuAe 

p/C^^eAen^ zaonomia pKUSiUiU In an HMO M aompaJizd 

ComnvUme^ytt to soc^^tal gooM iA)i^out majoh poMonat 
6acJLi^A.a€ 

Oppo^unuUeJi ^oa tmohmg and InteJiaaMon iA)^^ 
^tud^U An unlvtHAJXy AzJLattd HMOU 

Thz 4^ad£nt hko^d dzmonlitM^t thai fie can dM&aus^ 
ifte ^oltouoAMg phoblzm oi mzdiaat pmcMat In m HlhO 

High IzvQJt oi anhlgM±y dm to 4At££ evolving 
organization 

OKgayhLzaZLonaZ aomtMly^ 

Thz 6tadtnt 6hotLtd be cifa£e to exp£acn and to 
de.mn6tAatt appJwphiat^ wbo. oi tkt aompe^znoLu 
oi dliimtnt £evei pm^ltloneM 

In Kzlatlon to thz ioltMlng a^pz<^ oi hzaWi co^e 
VadjAnZ tdacailon 

HlAtoAy takifs and pkysla^ ^mmlnatlon 
Vlagno64M 

TAt(vbntnt aiik managmgr^ 

pJttvt^^on , 

In relation to dlvMAZ dia/LcuitMAAtlc^ oi tkz 
patlznt popt^atlon 

Agt* ptdlatHlQ^, lnJ:tHnc± mo^dlalnt, ge/UaZnlu 



ERIC 
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Sex I Ob-gyn 
SocA.o-taonomLa 6tatM 

PsychosocLaZ and phyhloML manZ^e^taX^OM 
mzchanihm 

Thz 6tudtrut ^houZd bt abl^ to a^\^)ZK qathttom on Xkg 
Holt oi iht home, acuit p^QHam on txamptt oi tzm 

VuojUption oi homz amt pKogn^m] 

Emmg^Jig JjoZo^Mt in aorMniUiy oi patimt 
aoAt afie/i kospitaLLzation 

Bcx)nomla imp£U.mtioM oi ifce homt amt p/wgHm 

Teojn appwaoh to tkt doMveM^ oi ktalth aa/te 
SQAviaU Am ^ft-e komz 

Ttm aompo6ltlon datthMntd by tkz mzdj^ oi 
tht patitnt 

Unlqaz 6UtLng ioK tht dzttveJty oi ktaZth amz 

HzaZ^ p/wvtd^ adoupting to zojoto.gy 
oi thz iamiiy, e,g* , <fee patimt Am ifae homz 
netting 

PaHznt con^JLLmaz md iamXy suppoJtt tmahd am- 
plmzntlng tkaJiapzLM.a goaZh ^wjolal to tkz 
4ucce44 oi ifce pKog^wm 

Home coAz H? usmu /wiz oi zdwmtoK to 
patimt and kU iamiZy about thjzc^mt plan 
and goa£6 

MajoK 4tAU6 on havAng poAtewi a£6ijum 
aatA^vz hjolz In t/LZ^mznt plm 

Home eoAe NP dzvA^U dl6ahaAg€ plan, and oitm 
aaoHdinatU oveAoM tKOMtmoj/^ plan 

Student should be ahte to tUt thz diHoAmau beMtm 
an tntzghatzd hzaWi caAt t^un and gHnup p^toattee 
(4paee ^kaMng] 4m t2/un6 oi» 
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ContinuLity ^on. iht pa^tLznt 

KnoiA)le.dgt oi and doyitacU ^Ith othoJi appH.opHA.atz 
pn.ovA.daM 

l^eMiods avcuLlablz ion dtJUvzHlng imuZy 
onltntzd hacUXh ca/tz 

Strndahdlzzd nmond kzzplng to ^acXC^ote Intm- 
pHX) loM^ionaZ commtmlccitLon 

JnteAdtpmdtyit pnoioASlonal H.2ZatLomkLp6i thz 
aott^gtcui appwoLoh 

Thz 6tadQ.nt shoL^d mdMAtand thz noMonale. bduMd 
tkt stHaatuAz and aompoiJXion oi the. ttam 

Advantage 

advantage 



Objectives in tiia Iffective Domia 

A6 a 6ucLaU6iiLl outaomz oi thz aU^oZivz igoAn^g, 

phy^tdan tn tnaJjung 6houZd cAoa^e to tn a tzam 

wheneueA p066ihZt* 

The. stadtyit should dmomtHMo. hU^ pn^eAmae. ion an 
undeJUtandUMg oi izm dztLva/ty oi hzoMh cam in 
tkz io££ou)lng wo^^ i 

Thz studzr^ shouZd ducJuhz ttam mnk ajb an 
tiitcimt meom to de^voA health aanz 

He should not avoid opeAattng as a tzam bzaoMt 
he. iinds it is timz aonsuming on avufrheMorm 

Tht stadeyit should dmomthjott km he. would handle 
tiiz iotZmmg pnoblzms a mmbeA oi a tmmf wfien 
mnking in ii^e HMO siting ^ hz should fae ablz to 
aAticLulatz iAe masom ion. dkoiaz oi coltzaguzs 
in mch situjoM.on 

ViagnosAA 

Wdtl-baby cmhh and aonsultatlon with poAmts 

Abontlon 

Viabztu ' 

185 Potzvitial s lUaidz 



T/ie physlUm In tmLrUng Mxould dtmomtmtt oMUudu 

tmaAd6 oihoA £eue£ pmat^Mon^ that trUtanat eif^eetiwe 

iaam imctLon^ng 

Tht 6tudznt shoatd cAoo4e to mafee 04 e ifae ^nde." 
pendeni aoiWiMbution that NuMt PmoMtloniA, 
Soaial WoKkoA md Phy6lcA.anU A^sl&tMt o^te capofcle 
o<( mdUng to hmJttk aoAz p^teitt 

Ma6i appmcA.at€ ^d ^MauZatt that o^qjl pHMtL- 
tLontU am not just txtzn^lon^ oi but that 

the.y b/Ung nm tm^ght^ ^HDm othoA d44QA.pJLLn^ to 
bzoA on patttnt'^ pMbJtzm 

EmmpZu 

So^aZ Wo^QA abtt to dAAgnose. and ^i^eAwene 
6aaa2M6£uZty i^^h mmtaZ he^cMh aompone.nts 
that physt^an n^ght not notice 

Naui P^atUU.on^-4 competence vUdi nantu/Un 
md mamgmmt oi duwyUaaily patimt6 

T/ie pky64.ctan Zn t/taMiMfig shoatd dzmon^tMtz tnmt 
that othtJt ttvQjL pKaatAZLonvu p^Kionm th^L^ ^mcMon^ 
aomptt^ntly Jm tht ioHouxing voays^ 

Tkt 6tudtnt 6houZd 6e able to u6z ^^oHmatCon 
^hjom hUtoAy and phy^taaZ dono. by Physiatan^s 
A66X4tmt OK Uvmt PKactttloneA 04 604^4 ^04 
diagno6tb and iwatmeitt^ HMthm than n^dotng 
pKoazduAQJi 

The 4tu.dtnt ^houZd faefcieue that tnio^MM^on and 
6appo/it on d%iJLdAQ.aH^g glvm by PzdAMtnta NuMe. 
PAactttioneJL /ia4 faeen adtqaat^ and aaauAatt 
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Prerequi sites 

The student will familiarize him/her self wiUi the 

•I? 

exp^ded nursing role ^rou^ tiie following articles: 

1. Bates J Bartara, ''Doctor md nurse: ^ chmging 
roles and relationships." New Eng. J, of Med , , 
283:129-139 (July, 19703. 

2. Lewis, C. E, a^d Resnick, B, A. "Nurse clinics 
and progressive airbulatory patient care." 

New Eng. J. of Med . , 277:1236 (Dec. 7, 1967). 

3. Lajiiertseni Elinor C. ''Not quite MD, more than 
PA." J. of Amer. Hosp. fisBOCi Hospital . 

In addition, references will be mde available on 
principles of practice and on tiie primary care practitioner. 
The student will be ©D^ected to be familiar with the contents 
of "A Medical Student's Guide to Health Maintenance Organiza- 
tions" pToduced by Simon, et al. at teorgetCTm IMiversity 
Sdiool of Ntedicine, Tlie Beniheim and Hertz reference is 
relevant here. 
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LeaiTiing Experiences ^ 

As part o£ devel^ijig his aa^areness of the ^fferences 
ajirang space sharing, solo practice i and the Perm-Urb setting, 
iJie student will be asked to attend specifically to differ- 
ences between space sharing as he obsewed it at the Hospital 
of the Ihiiversity of Pennsylvania and the collaborative 
practice he was introduced to at Penn-UA* The Pem-Uib 

Medical Director will discuss these Issues in a tutorial 
0 

conference. Other activities desired to demonstrate colla- 
borative practice to the student will include participation 
in the conprehensive exajnination, work witii the PONK, and 
participation m tiae worki^ of a mni contract following 
discission of tiie data b^e and problem identification of 
a plOT patient* Participation in the record review will be 
both for conpleteness and for management* This will be 
done both in pediatrics and adult medicine. 

The student will be required to attend a multi-disci- 
plinary plarming session about prd)lems of the family/ ITiis 
is included to illustrate how the social worker is invoked 
in a coll^orative practice* In similar fashion, tiie student 
should spend one session per week with a certified nurse 
mid>?ife teaiired with an obstetricim. Hiese experiences will 
be reinforced throu^ a weekly discussion of colliborative 
practice based upon the coll^orative aspects of health care 
observed by tiie student during his sessions witii providers. 

188 



Opportimities will be made available to allow the 
student to e^md and clarify his definition of the nurse 
practitioner in terms of expanded role practice, dependent 
and independent fimctions, accountability, and interaction 
witii other health providers. 

Experiences will be structured to provide opportimity 
for students to observe nurse/social worker, nurse/physician 
interactions within the context of the normal practice 
caseload. It is anticipated that the student will observe 
the pediatric nurse practitioner for two sessions, an adult 
nurse practitioner for two sessions, and a certified nurse 
mickife for two sessions. The student will select a nurse/ 
patient interaction from each session: he will disucss the 
interaction with the nurse practitioner, being prepared to 
articulate whether or not the nurse practitiCTier made a 
unique contribution to the health care of the patient. The 
student and nurse practitioner will allot the final half hour 
of each session for this discussion. The student will observe 
a pediatric conprehensive visit involving both a physician and 
a pediatric nurse practitioner. The student will observe the 
nurse practitioner interaction with the patient and with other 
providers. Discussion will focus on the content of tiie visit, 
assipment of tasks, family Involvement in health care plans. 

A nimtoer of other observations and ej^eriences will be 
designed to enhance the student's understanding o£ the 
psychosocial discipline as an integral con^onent of primary/ 
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conprehensive healtii care ajid his ^ility to imike appro- 
priate use of its services throu^ collaboration , consulta- 
tion, and referral, Teadiing will be carried out with case 
conferences, seminars , ini^vidual supervision ^d informal 
discussions* Consultation with tfie indivi^i3.1 student for 
the pu:^ose of dia^ostic evaluation, leading to recommenda- 
tions for treatment J, with enphasls in selection of tJiat 
psychosocial therapy most suited for tJiat partiajlar indi- 
vidual. TTie student will be assi^ed to a team throu^ 
whidi he will gain first'^hand experiential leaming in rela- 
tion to cases being serviced by his team. 

The Dental COTponent 
As a part of develcping the students* concept of a 
health care team, the existence of a dental coi^onent in an 
WO offers a special learning opportimity* The following 
module was developed ^ a separate but related set of laamin 
activities . 
Rationale 

Tliis section of the curriculun derives , as do the otiiers 
presented here, frOTi tlie consensus that the area of greatest 
deficiency in our healtii system is tiie organiEation of 
primary care. Since tiiis aspect of the heal "ft system em- 
phasizes Uie manageirent of COTmion and chronic prohj ':" v^^^ ' 
should serve as a link between the patient and ce t^ain 
specialized and tedmo logically conplex conponents r^-' h^:.xtii 
care. Oral health and disease is uraiistakenly witiiin the 

190 



m 



purview o£ primary health care and primary care providers 
must develop some conpetence in tiiis area i£ we are to mx- 
perience any imjor inporvement in the oral healtii o£ the 
nation In tiie years ^ead* 
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Objectives 

The. 6tadtni shouZd be capofa^e peji^oHmLnQ an onat 

Tht 6t\jdznZ 6koatd bt aapabtt ^aogyUzing a££ 
ti66m and tandmoK^ in tiioAA kejaMfi imaZt^td state. 

The. 6tudz^ should 6e aapabtt oi hzaogyU^^MfiQ tkt 
dL^^t^e^nm beMjozm yohat noHinaZ^ hzaZthy i44iu£ 
and that which p^eaen^ Jm aJUeAe.d statu htalth 

The. student shouZd fae aapc^it 0^ dLagnostng tht 
phe^mat 0^ thz most zommon o/mZ dZszasu 

T/ie studznt shouJLd be ^apablt maognizlng 
stgyu> and symptoms oi dtntaJt ca^zs tn tts va/vLoas 
stagu 

Thz Studzytt shouZd fae cwpabtt ^gaogni^ng thz 
stgns and symptom o^ pMlodant^ dcs^asz tn tts 
vaJiious stagzs 

The studzyit shouZd fae aapabZz o^ n^aogntzlng the. 
signs and symptom o^ maloa^^uslon 

*, Thz studznt should havz und^istandLng o^ thz baslas 

o£ tAzatmzyit loK thz dt^^eAznt dlszasz pKoazsszs , 

Thz studznt should fae ^omLllcut uoHh ^osz systzmia 
pMblzms OK duzaseA that ^Jizatly ai^zct dey^aJL 
tAzatmznt 

Thz studznt should fae i^zZt veMzd In thz pn.zaajMonaAy 
stzps involvzd tn ^Lzatmznt oi thz mzd^zaXJby torn- 
pKomiszd paZLzn^ 

Thz studznt should bz aapablz o£ cjoonJibiaZing ohM. 
hza^Zth zoAz wWi othzK hzalth nzzds oi thz paMzy^ 

Thz studznt showld havz aowple^z undzmtanding oi diz 

ImpLLaatlon o£ advanzzd dzntaZ diszasz and (A)hy m^Zy 

Azaognttton Is vttaJl, 

Thz StLdznt should bz ^mpztznt to zoM^ out dzntat 
pKzvzntion pKognm^ and omszss patlznts^ pHjogHzss tn 
oAoZ hygtznz 
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Thz 6tudtnt should be aompoXzyU. to aomiLmlcMe. 
e^^eciiueii/ yoUh dtntU^ aboixt the iolnt moMagmuJti^ 

The 6tudQ.nt should fee aompeXtnt to ^e^eA patient 
app/LOpnZc^zZy io^ dtntaZ coAe 

The. stadtnt should fee aomp^mt to tvalmta. 
t/Ltatmznt post op^Aat^vtly and assume /LUpoMA^^HiXy 
ion. iolLouo wp htalth m^y^mmaz 

Thz 6tude.nt shoudtd be weCi ve^ed In basla dp^ntaZ 
tQJimLnology 
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Prerequisites 

TTie student should stu^ following five references 

prior to attending the seminar* 

1* Gerrie, Normm F. md FerrarOi Mchard H* 
Organizing a progran for dental carte in a 
nei^borhood heal"di center, PtAlic Health 
Reports , 83 (8), August 1968/p, 633/ 



2, Sdionfeldj Hymm K. Origin and ^wtii of dental 
group practice md closed panels* New York 
State Dental Journal ^ 36 (2) , Februaiy 1970, 

p. 77. ~~~ 

3, Dental expenditures, utilization , md prepa^ent. 
Blue Cross Reports , 1 (2), September-October, 1963, 

4* Nikias, ]^ta K* Prepaid dental care: Patterns of 
use and source of premiDTi pa>niient* Mterlcan 
Journal of Public Health , 59 (7), July 1969, p, 1083, 

5, Nikias, Mata K, Social class and the use of dent^ 
care under prepa^ent. ffedlcal Care , VI (5) , 
Septenier-October 1968, p* 381* ~ 

L earning Experiences 

The objectives will be iret by the follwing approadies: 
A* Seminar* TTiis will involve a slide lecture pre- 
sentation BTid follw up disajsslon, 
B* References t These will give students necessary 
backgroOTd infoimtion to better imderstmd tte 
seminar and for future use. 

C, Clinical* Time will be spent in tiie exaninatim and 
treatment of patients to allow students the ^portimity 
to reinforce material presented in tiie Senear, 

D, One two hour seminar will incorporate a clinical 

* session for introductoiy mterial* Mter that it will 

be optional if the student desires to pursue tiie sub- 

ject in greater ctepth. 194 



C. Module 3: Active Consmner Participation in 
an Organized Healtii Care Setting 

Rationale 

Recent years have witnessed a marked en^hasis on 
consumerism- -the expectation and rigjits of the consunter to 
full informaticm about the services being purveyed. In 
contr^t to other seiviceSj health care, if it is to be 
conprdiensive, actually depends ^pon active consumer in-^ 
volvement in order to effect favor^le outcomes* The con- 
sumer or patient imst be an active menber of the health care 
team if preventive healtii care is to be practiced- -he cannot 
remain passive. The consumer's conpliance is inperative 
and conpliance is related directly to intelligent involve- 
ment. Furthermore^ if the health care system is to be re- 
sponsive to "flie needs of the constmierj then tiie consumer 
must be motivated , educated^ and sophisticated enou^ to make 
an intelligent assessment and staterrent of his needte. 
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ectives in the CQgiitive Domain 

, Glvzn a quutlon about tht nlghth oi patltnt In an HMD 
S2Mlng, tht i^tadtnt 6hould fae aB£e to IncZudo. the. 
^ottoijotng po^rit6 1 

?cM.zntU night to t{a££ Iniomatton ofaoot hU o(^n 
ktaWi 6tatiM 

PKtvaay /aon ^dtnttaiAXy 

Iniomatlon abo^ pit natu/LZ and aon6tqmncu 
p/iacLztduAeJi and tnt2A\je.ntton6 

CompZalnth md c.ona2An6 oi patttnt takm seAlouiiZy 
by mtvthQJU> oi o^anLzcM.on 

. Tfie studznt should fae abZz to dmomtAMz h^ unde^- 

standing o^ the. tmpoMmoA oi aetiue patiti^ pa/M.(Upa- 

tlon Jm tht htalth amz pwaU6 both by feeing able, to 

dwcyuie tt4 Implications and by hUA behasjloK* 

Stadtnt should fae obit to lUt th^ ioHmtng 
^zatuAU oi patte^nt zdaaatlon' 

Pattent should fae eduMted about tmpo^itancz oi 
hzoMh malntenante^ tahly deZz^on and pKe- 
vtntton oi AJintss 

Patient should feaue a dtoA undeJtstandLng ^ 
thiough tdmation by tfte healM aam tzam, oi 
hovo his b^avlofL tmpaots upon hU own h^oMi 
status 

tnc/imstd patient aompHmae. uUth t/ie.a^ent plan 

hoped to fae an outaomt oi thg hoMMh qmM. 
ttmU aomru^znt to htaltk zdutatlon and 
patlo^nt pa/M(Upatlon 

Studtnt should fae ofa^e to dtscMbe. the. u)ays lniM.di 
aonsumz^m tmpac^ an oKQonlzed system oi health aoM. 

Vlvld^ fenotu^edge and JmponslblUty faefioeen 
pjwvldt^ and patient 

Utjo^iAMhu ImpoHtanae. oi di/itct chmnels oi aomm- 
nlacM^on aJLOund patlznt-s eoneew4 on. ^omplaJMs 
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Skapu typt and timinQ oi 6tK^laU /teHdeAed 
Studmt fihould do pcM.mt education In aM po66aMI^ 

Studtnt should dQ^oMtmtt that hz mgouud^ zduaa- 
icon Ob a (Ugh phlonAXy^ whzn ckolau must fae made 



Objectives in the Affective Domain 

Studznt ^hoixld undoMtmd that actlvQ. patLznt poAttot- 
patLon In htaiM toAe. pwau^ l& AJnpo/t^yit. 

Thz 6tudmt should Kzalizz th^ thg patltnt has tkz 
pmm to inilumat hU mn hea£tfe pJwaU6 

Tht 6tudmt should fae abtz to dtscjUbt stJiMtglU 
by yohtch ht muld cMmpt to A^nvolvz patLmt In 
own hzoMi ooAe 

Tfie studffM shoiild Itam to valm patLmt' 6 aonMl- 
button In ducJuMtng pwblm and potential soliMon& 

The physician In ^laliUng should mgoAd iuM Inioma^on 

to pctlznt about hzalth status and aonszqamau o^ IntoA- 

vgntLon M ethlaal obligiMon. 

, . . Th€ physician In tmlnlng shoutd mgoM patlznt. tduaa- 

tton as an oss^rMcU. aomponznt hzaUh aoAo. 

Student shoijld U2jL gnaouMLgzd about possJJblt 
pos^vz outaomu iMm tune. spe^^U on patLmt 
gduca^on 

Stadmt should UaAn to mgoM lack oi aonplLanct by 
patlMt as possMe. iaJMiM. to be con\)lntUMg about 
^^alMdXtij oi IntoJivti^on 

. . . Stadtnt should uocmt to mnk In a setting wfte/te patient 
satUiactlQn Is to^en seMtously as a mQ.asuAz oi quality 
0 i aoAt* 
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Stiidt^vt should be 6 2.ri64M.vt to pcM^tnt ah wholt pm&on 
4ai/ieA thMn body to fae ijoo^td on 

StLjudznt 6houZd opp^eecoie oppoM^tmtty ion. t)^mdtd 
aontAaat wtth pcM.znt6 a6 human beings 
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Prerequisites 

Before attending the various experiences outlined in 
this section, a student should stu^ tJie follcf^ing references. 
TTie student also should have mastered the content of the 
Patients Bill of Ri^ts issued by the i^erican Hospital 
Association. 

1. Ftedmanj Barbara K. Patient education as a function 
of nursing practice* Nursing Clinics of Nortii 
Anerlca j 6 (4) , Decentoer 1971, p. 573, ^ ~ 

2. de Tomyay, Wieba* Toward coi^umer-oriented 
healtii care, 

3. Tosteson, D. C* The rl^t to Imow: Public education 
for health* Paper delivered at tiie plena^ session 
of the AAMC Amiual Meetings Qiicago, Illinois ^ 
NovejiiDer 13, 1974. 

4. Lwis, EditJi P. Tlie health care consumer; 
Conpliant captive? . 

5. GilliM, Ridiard F. and Barsl^^, Arthur J* 
Diagnosis and mmagement of patient nonconpliance. 
Journal of the An^ricm Medical Association , 

228 (12) , June 17,. 1974. ~~ 

6. Pomerleau, Ovidej Bass, Frederidc, and Crown, 
Victor, Role of behavior modification in pre= 
ventive medicine. New England Joumal of 
Medicine , 292:1277-1282, Jime IZ, 1975* 

7. Be^er, Marshall H, and ftolman^, Lois A* 
Sociobehaviorai deteimnants of conplimce witti 
heal til and medical care recoirmendations, 

8. Monaco p Rose Mary, Salfen, Linda, and Spratt, John S, 
Tlie patient as an education participant in healtii 
care, 

9. Simon^, Scott K, Current issues in patient 
education . Not YorEl Core Conmmications in 
Health, Inc. 
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10. Moffat, Samuel. Patient education: A new 
weapon against malpractice suits* 
Medical Alert Comfrnxnications 3 2 (6) ^ Jime , 
1975* ~~ ~~ 

11, Lesparre, Michael, ^e patient as healtih student. 
Hospitals p Journal of tiie Ainerican Hospital 
j^sociationj 44^ March 16, 1970 

Learning Experiences 

Seven distinct experiences have been outlined for thm 
student to adiieve the objectives of this module, ITiese are 
botii observational and behavioral in terms of what they re- 
quire of the student and as sudi should contribute to an 
active learning process. 

The seven experiences are outlined here In the sequence 
that would optimally introduce tiie student to tiie curriculum 
content of this section. 

1. Participation in introductien of patients to the 
Penn^Urb system by the Patient Service Representative, 

2. Observation of first part o£ the conpr^ensive 
physical examnation by Mary Dou^erty who will 
describe how she works with patients ; why It is 
djnportrnt to tell patient exactly what is happening 
wltii eadi test and why; what difficulties are en= 
countered in djtaining test results; how she relates 
to otiier providers, etc. 

3. Observation of patient "provider encomter re patient 
education. 
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4. Attendajice at a behavior modification session con- 
ducted by Dr. Ovide Pomerleau with B etsy Itoeback 
conducting a 20 minute didactic session beforehand. 

5. Attendance at a health education session where group 
menbers share a common disease. Lew Wells will 
conduct a didactic session beforehand on group 
interaction. 

6. Attendance at Penn-Urb Sidiscriber Coimcil Meeting. 

7. Review Penn-Urb PiiDlic Relations files and news- 
letters from pro. Harvard Comiunlty Health Plai, 
and Colunfcia Healtii Plan, and draft news article 
for submission from Penn-Urt! to PIff newsletter. 

The staff work group responsible for the design of this 
module elected to delineate the specific activities of eadi 
of the above experiences throu^ a series of stu^ questions. 
These questions as given here represent a detailed guide to 
focus the attention of both student and staff. 
Experience 1 study questions 

1. In what w^ are consuners presently introduced 
to a healtii care system? How should they be 
introduced? 

2. What points should an Introduction to a health 
care system include? 

3. How does a consimer choose a health care provider? 
Miat infonnation should he/she have? 

4. In what ways does tiiis experience encourage active 
consimer participation in the health care process? 
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Experience 2 study quest ior^ 

1. What are the consunier^s thou^ts about or reactions 
to healtii screening mid testing? Does he/she con- 
sider the process valu^le, necessaiy, appropriate? 

2. In what way does tiie HeallJi Care Assistant e^qplain 
tiie experience prepare the consigner? 

3. Miat is tiie significance of this experience in re- 
gard to tiie conswner's introiiction into tiie system? 

4. What Is the role of OTcillary personnel such as the 
Health Care ^sistant in health care services; ar- 
ticulating for the coi^urer^ provider ^ md Hie 
system; and promoting good relatioa^? 

Experience 3 stu^ questioi^ 

1. Wiat ^pect of the interaction best illustrated tiie 
process of health teadiing on the part of the 
provider? 

2. What teaching techniques did the provider ©nployj 
e^g, j verbal description ^ malogy, physical demon* 
stration, use of printed materials and aids? 

3. How did the provider assess the patient -s leaniing 
needs? 

4. How did tiie provider assess the patient's willing- 
ness^ ^illty, and readiness to leam? 

5. How did the provider convey e3qpectations and 
assi^iment of responsibility to the patient In 
regard to learning? 

6. How did the provider assess that leaming on the 
part of tiie patient had or had not occurred? 

Interviewing tedmiques en^loyed? 

Other techniques e^l^ed like patient demonstra- 
tion? 

Criterim Masures utilized? 
How deteimned? 

7. How did tiie provider deternmie and deal wltii ob- 
stacles to learning? 

8. How did the provider dorament in the record tiiat 
teaming md learning had occurred? 



ExpGrience 4 study questions 

1. What is a brief working definition of behavior 
modification? 

2, What are possible applications of bdiavior modifi'- 
cation to healtfi care? 

3. In what ways is use of behavior mo^fication therapy 
in health care con^atible wltii the concept of the 
'■activated consimer"? 

4, Miat behavior nrodification techniques are outlined 
in this gro^p session? 

Experience 5 study questions. 

1. What is tiie stated purpose of iJie group? 

2. mat is the nature of Uie groups e.g., didactic, 
interactional? 

3. Does the group appear to be working in a 
consistent witii its stated puinpose? 

4. In what w^s are teaching ajid learning illustrated 
within the group? 

5. Vfliat patterns of interaction niay be observed within 
liie groi^? 

6. Miat type of leadership be observed in the 
group? 

Experience 6 study questions 

1. What is the stated purpose o£ the groi^? What is 
tiie nature of ttiis groiJp? Vfliat ^e of leadership 
exists --fonnally and Informally? 

2. Who are the jnenters of tiiis group? Vfliat is their 
motivation for joining? 

3. How does this group articulate with FW and with 
Penn-Urb? What is the nature of tiieir frandiise? 
What is the nature, of their input re adviseiiBnt 

and poliQ^ making? To whom is tiie group accoimt^le? 

4. How does this group work- -contributing and listening, 
synthesizing, arriving at consensus? 



203 



Experience 7 study questions and activities 

The priinaiy requirement is for the student to write 
an article ^out sore aspect o£ healtii care at PeTm-Urb for 
SLtomission to PIff Newsletter, The puipose is to use tiiis 
mediijn for patient education, Otlidr optional e3q)eriences 
include involvement in an interviewing and picture -t^ing 
session by news iredia in the Hff network, participating in 
an interview wi"fli reported regarding the student's Penn=Urb 
clerkship, or Interviwing a PIW staff meirber regarding network 
attitudes and participation, Bnd consider participation and 
education. Stimulus question mi^t include the follOTing: 

1. Who is the Plff/Penn-lJrb consumer demographically? 

2. Wio are tiie targets of tiie different PR timats? 
3* What messages are Intended to be cmveyed? 

4* Wiat different media are enployed and for what 
purposes? 

5* How does an organization go about attracting and 
utilizing the media for its purposes and what are 
tile professional/ legal restrictions on advertisement 
of physicians' senrices. 

6. What input do consuffners have in tiie use of media? 

7. In what w^s is conswner education accor^lished 
^rou^ tiie media? 
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D» Module 4: One Quality Health Care for All 
Rationale 

Today healtii care is a ri^t rather thati a privilege, 
and therefore it must be avail^le to all persons at con- 
sistent quality. IVhen healft care is examined witiiin the 
context of accessibility, continuity, conprehensiveness, 
md account^llity, it becomes clear that there are gross 
inequities whidi have tJieir bases in socioecOTomic, etimic, 
and geographic factors* Future provider and plamers of 
health care will need to be sensitive to these issues so 
that nmly developing healtii care systems will overcome the 
inequities* 
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ectives 

, Given a qm^tion dbout tht iyp^ o£ mtdLaaZ coAe cu^- 
mntly avoJjMbtt to patltnts ^ thz tf*5,, stadmt 

TKadAM^ondZ paMeMM o£ aoAz ^oK rrUddZe. cZm^t Fee- 
^o>t-^e4u4ce, p^^uote p4ac^ce phy6A.ujm 

TypQM ol p/LacZiat tivtoij^h vohlch GOAe ^ defctueAed 

GmoJmJL pHjoLQXAJU.QnVi i/oko tAmi6 Mhot^ ^miZy 

TamJLy hmWi nttds met 6€paAat^Zy fa^ 4nde- 
pmdtht hptoMoLUt^ 

Emph(uZ6 on zp^odLa aa/tz, m^2/L ^an on pKo.vm-' 
^Lon and modLiic£uU.on oi kmZth JLodjoXzd behavM/L 

FinmcA£LZ AMa^ntLyu wo/tk agoAMt pM,vmtlvg 
meitotne 

Potcejit edacotton tw pnJ^oJuXy 

TKadZtA^onaZ pcMmn6 o£ cewe ^o^ poon 

S2^t4Mg AM tjohCch aoAjg am pnjo\)Ld^d 

Ho6pitat cZtnia a typlcaJt 4 eating ^o^- aahz 

No aon^imi piMonaZ p/L0vA.d2JL yoJMi whom one 
con A^drntA^^y aji oLlnia ^etting^ 

PoAcent edua^fcton not pHjovtded ioK wiuUnt h2.aith 

ThJj^ pcLH^ paymmt6 tivwugh pubZM^ funding MuaZ 
meAfeod oi ^v^rbuMe.mmt 

Studonts skouM be ab£e to duc/Ubz ifee dM^ioAmae^ 

faeAueen Penn-tkjfa md ^mdUMonaZ modoM aJLl cZa^4iU 

Attempt to mofee mz^od oi pcuymmt A.ndtpmdmt 
styZg, qimH^ oi cjxJui 

P^bZtm A.n\JoZv2.d An att^ftrptLng to o^^eA wfU^loM^ 
jfUgh qiwZJXy aoHM., dwp44:e th^ dLiieJtint paymmt 
m^hodU used AM a pHjjMJtjy aa4e aen^e4 that has 
many ioJum o^ A^-tmfau^ement 
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A66amptLon ^at pK^-paymgyU mold aZZot^ aomp/Lt- 
htm4^m aoKt to be oiiz/ttd to att pc^iznt6 

Pzm-Unb uts^tUhtd uoltk aim oi pKovtdLng hMgh 
quaZlty co^e amo66 socZo-monomla 4ptctHm 

Eaotogy tkt aoMumzA 4een ^6 tmpo^ant aompOYLtnt 
0^ high qaoLLty health aaA€ 

\^^r^lnadUMMnsJL poMLtHnh oi mtdlaaJL coKt had too madi 
^mgrmntaMon af aoAe. to aJtZou) muc/i knou)ltdgz oi 
hit taoZogy, tncZadLng dynamL(^ o^ thz ^amlty 
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Prerequisites ■ ' ^ , 

TTie student should preview the videotape in whidi 
Dr. Hertz conducts interviews with "^etto'% "Biyn Mahrr'% 
and "Penn-Uit" types o£ patients vis a vis ttieir he^tii 
carep Student should also have read tiie Health-Pac article 
and the article by Bdderfieiiiter in the Septeri)er 3, 1970 
issue of Inquiry III entitled "Pattens of American Antsula- 
tory Care*" 

Learning Experiences 

The broad goals of this TOdule require the student to 
define conponents of "Quali'^" care, look at traditional 
patteira of care for m^le class and poor in terms of 
their ^solute and relative quality, and look at Penn-UA's 
health care* The criteria for Msessment will be the 
degree of quality and extant to whidi tiiere is one qiaality of 
health care for middle class and poor patiente . Thm student 
will be required to make a camparism of Perai-Uib health 
care to the patient's previous health care, to identify ways 
in which Penn-Uib is still a too-class system^ to poijit mt 
the problems in overcoming a two-class system^ and to suggest 
means for achieving a one-class systOTi in Penn-UA* 

l^e opportunity for an malysis of Penn-UA's qimlity 
health care will be offered tfirou^ . intervi ws with svb^ 
scriber and clinic patients regarding their healtii care ax- 
perience at PCTn-UA coj^ared to tiieir previous heal^ cara 
e^qperiences . M intervlw form should cover elements of 
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^'quality-*: access ibilityi accoimtability, continuity, 
comprehensiveness* Following the interviews, the student 
will meet witJi staff to discuss inpressions of the inter- 
views. Each student should interview at least two patients 
who will have been screened by providers, 

A checklist for the inte^ws includes tiie follwing: 

Accessibility : 1 , Appointtients 

2* 24=hour avail^ility 

3, Use of referrals 

4, Geographic accessibility 

Continuity: 1, Primaiy provider who coordinates all 
activities vs, priiMry tean relation- 
ship to -specialities 

Conprehensiveness : 1. Education- 'explanation of prob- 
lems^ cf, to J preventive care 
and education 

2, todewtanding/ integration of 
psyAo-social factors 

3, All TOdical/mental health needs 
met; not fragnented 

4, Relationship of health center 
to cttmnunity 

5 , Periodic follow-^p 

AccoLDitabllity: 1. CoMumer input--formal (p^ievance 

procedure, declsiOT m hiring/firing 
policy dianged) and Infomal Cfmrnd-^ 
back to provider) 

2, Conimmity out-readi 

3. Peer review/ chart audit 
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A suggested pattern of questions follows that i^ed in 
the Hertz videotape of the three patient types, 'niose 
question were: 

1, Where do you live? Main source of income? 

2* Where do you get medical care? For exanplej do you 
go to a private physician ^ healtii center^ hospital? 
How ^out if you had a problem witii aller©?'? wi A a 
skin r^h? a feeling of serious depression or 
amdety? or needed a general diec^^? 
If you need to go to a ''specialist** (e.g.^ a surgeon) 
who pulls it all togetiier? who follows xipl 

3. How do you get to your physiciaip health center or 
hospital? 

Transportation 5 parking, wheelchairs 

Office hours: do you miss work? 

l^at h^pens if you are ill an weekends or at 
ni^t? 

4. Can your physician (otiier proyider) explain thinp 
to you well? Is ftere time? Is tiiere a barrier 
between you? 

5. Have you been satir^fied witii your healtii care? If 
you had a suggestion or a conylaint how would you 
handle it? Would your physician care? 



210 



B, Module 5: Economcs o£ WD's 

Rationale 

The economics of health care is an ijTfportant topic for 
stu^ because financing affects delireiy of health care 
and shapes Idle type of practice in whidi stiidents will be 
involved^ tiie quality of care tiiat will be offered each 
patient, and ultimately will reflect back on tiie general 
quality of life in the society* 
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ectives 

. Thz stadznt shot^d fae obit to txpUln th^ Usaz6 

ConhmeJL*^ Mgthod& by wkLdi tht aomtm^/L pays 
ioK hzat^ qjojiq: 

Concu/Mint paymmt — anoth^ AXtm ^ ifee 
hoLJUbekotd budget 

Msmu fedtcot caAjt ^ on acatptabtt H^k 
to coMjy (jotthout tmuAmat 

PaAtLatJ^taAly applLaablt ion. smZl spohmUa 
zxptnditu/iM ioacMstonaZ zptsode., oaaas- 
sionaJL p/LUcALj^on) 

?Ktpaymmt--aoMm2A pays tnto on usance imd 

ActuaAlaJUy ilguAjid on *fte Msk oi ^ne^dence 
oi tUnus 

Spmadb tii^ bast oi paymmt 

VHjoiuslonaZ handJUng o^ mmy 

P/LOvMw Hou; the, pHjovtdeJL maoMvu pa^me.nt ioH. aam 

Fee-^o^-^wvice paymznt—ioK mch S2/Lviat phavtdzd 

InaeJttcOe to produce monji mits svi\)lm 

foK tach tAOMac^on aonsm^A kas cfcoXee oi 
pKovJ^doJi 

Capitation- -payment poA JMdlvidmZ io^ mdimUy 
detMmtned ntmboJi oi sptQA.ilQ.d saJivlau ion. 
sptdilzd Zmg^ oi tLmz 

fnovldoji shams J^e nASk oi dMnus/utAZLzatton 
oi smvtaeM {JO^Mi aomumeJi 

tnmyvtLvz to feeep tki. IndLvlduaZ hmZthy, X.e*, 
not uMZLzlng 4eAU4.ce 



Conccmeni* ^ee^^o^-4eAu^ee ^ i^e nw^i, cowmon method 
0^ paymeiii p^maAy aoAt 

Sim Cwh6 + 8£ae ShlM appMach 

PKtpaymzntt aapJXation 44 tht HtaZth UaMntmmm 
O^ayUzation app^oadi 

pKovldejL hM the. i^MmcMal Inmntivz to feeep^ 
pat^tvit htcUXhy md to havt ifie poMmt utilize 
tiiz moht co4<-e^^eetcve mode oi doZ^My 

Ha6 ££d io £0M;e4 ho^pUal ijMMzatlon nktu 
i^oK HMOU 

GmoAMjy, hlghoA u^Zlzcalon oi pM.ma/ty aa/Lt 
42AvlaU and gHAOteA utltLzatLon oi p^eve^itive 

No ew^denae ifeai he^aJUh 6tatu^ U Iniz/UoK, and 
4ome ev4.dence that bett^A htaJUk status ^ 
aQ}u.tvzd 

?/L0vld2A can faudge* /ledou^Lcw and utitLzz 
miottnt mmag^UaZ t^ahnlqim 

... Tfce 6tud2.¥it 6hoald fae a6£e ia exp£^n feau i^n^ocng 

aiitcM zqai^ oi medtoot coAe* 

Pe46ona£ mtdLcMZ ca^e Kuoum^u oaz aMoaato^d by 
tht mMkot mtchoiUsm 4M AmojUaa 

PKoblzm oi ccka^tAophla ao^t oi pwlongtd tmatmznt 

?/Loblm oi ^Ing eo4A of ^eguto^ i^eaCmeni .inWfa^- 
^ng 4Dme conaum^ ^eaeiu^ng ca4.e 

Solution 2Wi2A a non-ma/iket allocation oi Kuoun^u 
I.Z., a plmmlng model, moUng tho. base, oi p^- 
mmt moK^ ^qultablz, X.e*, mdU^t^utlng puJiohaA- 
Ing capafa^ttti^ 

S^nce ^e HMO U not a dka/Utable. ae^iuit^, 
tvQAyont must bt m^lltd by peeing a p^mlum 
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Tht HMO ^ ao6t e^^ecwttve, though, wft^c/i 

^ and Medical 

Al4o, con heip b^Ang h^aMh KUOuAaU to 
undiA^4&Avzd comunXtiw by p^vidlng a 
mtionat stAuatiMi ion. p^^ice 

The 6tad^i^ shouild md^tmd ifie ^^neuicUa£ deveCopmeii^ 

0^ HMO. 

P^nricrtfl 6tagt' am the HMO ieM4hltf 

Vo the. mausoJiy KUOuAn^U tXAMt {phy64.CA.aM, 
ho6p4J:aJt6 , CLopitaZ, tmmjgmwt, coMurnVtM] 
0^ A4 theAz a good pAjo^ptat diat thzy aan 6e 
puJUzd togetheJi 

Re^icue -inexpend^ue, but need 2.ntAzpH.me.iinA.at 
talmt 

V^voZopmrnt ^toigt^ patting the /lUOuAau togathoA 

Vetg/uniyiLng and sotimg up ao^oHotz 4ttAuatuA^ to 
4jnpZ€mmt ptoM 

ComtmcMng on. Jtmova^ng math^cjvy iacAZMZu 
B^ingtng tog^ieA mausoAy p/iovA.deM 
GtneJi€utJLy nzquAAe^ $Jt-JDi rtUJIMon Zn iwvit md imdt 
lmplmmtatA.on ^ta^tt MundUng -the HMO 
StoAt^g to pJiovtdz acutz 

Need io/L "tuLHn aJwimd^imda" to support HMO An 
pe^od tmtlt tnHoMmmt catchu up to muumum 
teue£ o£ expenditcm wh^ch u)a4 nmuscuiy to 

0^^2A 62MJACt 

TAtAat4Mg txpoMAon* nm ^uolaom u4. AncAzmeM 
In mAo^^mnt 
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Prerequisites 

ITie student will be conversant with the material in the 
follOTlng references prior to participating In tutorial con- 
ferences and seminars* 

1. Sawardj Ernest W. The relevmce of the Kaiser- 
Permmte experience to the healtii services of the 
U.S. Bulletin NY Acad, hted . 46: 707-17 (Sept- 
entser 1970) . 

2 . MacColl I William A* GrQup practice md prep^TOnt 
of medical care . Washington: Public Affairs 
Press p 1966. 

3t Donabediani Avis* An evaluation of prepaid group 
practice* Inguliyj VI (3) , pp. 3-28* 

4 SmsLTd^ Ernest W. ^ et al* Docynnentation of tt^enty 
years of operation md growtii of a prepaid group 
practice plan. Medical Care ^ VI (3) ^ pp* 231-44 
CMay-Jime 1968) . " 

Learning Ejqserlences 

Since Ae material on the econondcs of WD-s is largely, 
cognitive I we have imdert^en to develop autotutorial 
materials for tiiis area, A cassette recording of the 
Perloff ID 103 presentation h^ been made. This is now 
transcribed and edited md will be retaped in order to inter- 
sperse self-administered items testing the understanding of 
basic principles. 

The student will be e^qpected to adiieve masteiy of tiiese 
materials prior to involvement in tutorial disucssions with 
the Penn-Urb economist/adiiijiistrator. 
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F* Module 6: Sociologic Considerations 

Rationale 

The problems involved in delivering quality health 
care to ijie TAiited States p^ulatlon to^y are co^lex* 
Appropriate resolution of tiiese problerffi will derive not 
alone from the biomedical sciences but mL^t involve tihe 
social sciences as well if a healtiiy population is to be "fte 
objective. This is particularly relevant to the ^ysician 
in^ training who may be contenplating a professional career 
in m IM. Here preventive medicine as well as episodic 
care depends on an environmental and contextual imderstanding 
of the p^ulation being cared for. The concepts , skills j 
TOthodologies , and tiieories of the social sciences provide 
the physician wift a broader Imowledge base for managing 
tiie social, psydiologicali historical, political and economic 
dimensions of healtii caret In acWition, to move tiie presmt 
massive mgoing structure of healtii care delivery in socially 
relevant directions, the physician of tomorrow should toiow 
SOTiething of the stimtegies of plamed Aange and dissendnation 
of innovation. 
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Objectives 
VlmnidChmgz 

The stwdgyit should mdeMtand tirn pkmomma oi planmd 

diangz in pM^onaJLLtij and ^oc^aZ system^ 

Tht ^tud^rtt should knm de/^iu^on oi plmntd chang 

Tht studznt should undoMtand motLvatA.on ion. a 
p^onoXJj^ OK OL so^aZ systm to ohrngt 

The 4iadeni should undeM^d th^ phasu oi plwrntd 
ahange 

The studtnt should undMstand tho. puatss oj Mjlam^ 
md tk% mtdfiaMsm undMAly^g mck stago. oj{ change 

The studtv^ should undeJts^nd ihe 4o£e oi thi e/ionge 

The student should be iamlMaA mth metfiarfa oj 
c hmqlnq ^dbjldmls and system 

tnnovntlon 

... The studznt should undaMtoind Ahe phmonma oi Innova- 
tion as ^ K^latu to hzaJUh systaM 

The s^tnt should knouo thi dzU-nLtlon oj Innovation 
The studtnt should mdtutand the. phasu oi Innovation 

Studt^ should undeMtand the, attJuhutu oj an 
' " lmovatA.on 

Studtntt should undMS^d thg. tjypu oi Innovation 

Stadtnts should und^Mtmd the. diaAaotMlstlcs oj 
mJdiy adopteM 
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. t * T/ie stiidgnt shoatd kavz a mhMng knc^itdgt oi ' 

• T/ie siudtnt 4houtd &e a6£e <o dwc^^e ifee dc^^eAencM 

pA^a^Lm phy^Z(UMM^ hospAJtaJL 6 06 erf 4peaiaW4<6, wd 
HMO phy6i(U£M, uU4h ^wpeet ifte ^o££ow;^g ciimen6<=o>i4 
Tkz studznt should imdeMtmd thz pKoaus oj pHP- 

Thz h^udmt should be. ^amLlLm iMih ih^ aorMjoJU 
yohCch a^^t^ pHn£u6A.on 

Thz Atud^ht should be moAt ifce /L^MtLoMtUp6 
0^ mzdioAA^ with oikiA ho^aJUk p^^MS^oM 

Thz stadmt should feww? about pHajoMSMmt aMsooAM^ 
tloM md aolZmaue. A^latioM 

OKganizcMons 

Tht stu^nt should fertw tht e£emeii^ o^ on o/LgasUzatlon, 
Th^^studQ.nt shouZd WfidMStand thz n^JjotloMhip teAoeen 
IndLxu^duaZ and the. 0AganJ.zattoni 
. Thz 4^arfen^ shouM be ^anuJUoA uMh thz stmatuAe. o£ 
m o^gam.zat4.on^ 

The. studtnt shouZd knojo about oAgantzatLonaZ goaXA 
. . . The studmt should mdeMtmd hw pmvi opoAjatu 
m aAgaM.zatlon, 

Tht stade^nt should undMStmd how aon^ats oaauA 4m 
an oKgantzatton^ 

• • , T/ie studtnt shouJLd andoM^d the. mv4Jiome,nt tn 

wh4.Qh m ohgcufUzatlon o^xMsti* 
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... T/ie htikdrnt should md&utand InieAonganlzatlonaZ 
H£jLaZLon& . 

... Ihz Uadtnt should be. ablt to apply thuz gmejial 
conczpU to the. context 0(5 iptUila koMth coAe 
ohgayU.zatA.on6 . 

neAe.aAch in He.aJtth CaAe. PeMveMM Sittings 
... The. 6tade.nt ihould undeMtand th& phocUh and iMpontancz 
oi behavional faience Aza&aJich in he.aXtk comz deMvejuj 
iejttingi.' 

The Atudznt should undeMtand ihe imetiau^ oi 
HsAzaAch 

The. itudznt should undeMtand the. itmctuMl 
componznts oi a JLe^e.aAch pnoject 

Tke student should undeMtand how AUzaAch i4 
aonduLct&d in the. seMtng 
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Prerequisites 

For students witiii no sociolo©^ background, read 
iokeles : Wiat Is Sociology? 

Oilier required reading will include: 

1. Friedsm^ E. Profession of Medicine (selected 
chapters) 

2. Trela, James and 0 •Toole, Mdiard, Roles for 
Sociologists in Service Organizations . 

O^er SL^pleTOntaiy readinp will be avail^le on 

request In tiie student's area of Interest, ^ese tacluda' 

3. Loflandp John* Malysing social settings , 

4t Rogers snd Shoemaker, ConinijilcEtion of Imovation . 

5, Georgeqpolos ^ Basil, Organizatign researcji on 
health institutions . 

6, Riley, M, W, and Nelson, E, Sociological observation , 

7, Franklin and Osborne, Researdi methods: Issues and 
insists , 

8, Bneiy and Trist, The causal texture of orgamza- 
ticffial environments ," 

9, Case studies on orgmizatlonal issues developed 
at Pem-Uib, 

Learning experiences 

C^e studies aialyzlng varloi^ aspects of heal"fe or- 
ganizatlons will serve as ttie mjor vrfilcle by whldi ttiese 
sociological concepts will be tau^t and applied, Eadi of 
tte five topical areas will be dealt witii as it applies to 
the cases being considered. 
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The material will form a b^is for sn^ll group discus - 
sions and individual conferences. Specific issues o£ in- 
terest to a student or to the groi^ will be further explored 
-flirou^ groip participation in focused intep/'iws with the 
providers who were active In tiie events beijig analysed in 
the case studies* Enphasis will be placed on meeting an 
individual student's neecfe and interests ^ they relate to 
social science and researdi in ^e healtii setting. Students 
spending extended periods at Penn Uib cm be mtroduced to 
the tedmique of participant observation. 
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Rasource Paper No, 5 

PROPOSED CLEMSHIP FOR THIRD-YEM mmCAL STUDENTS s 
RATIONALE, OBJECTIVES , METHODS AND PM^qUISITES * 



From Appendix J of the University of Washington Final Report, 
Project to Develop Curriculum For Physician Training in iMOs 



II1STruCTI0H/,L goals m mMllm 


IfJSTiCTIOflAL HETH0DS 


EmUHTlON HETHODS . 


I. CLi:iI«L eo/SL Primary Cars 






.The stydtnt wll pin ^nowledgi of and skill in daaling 
with the mm Mi\\ problis encoufitirad in providing 
priirary Hidica] cari. 


1. Pariicipation in patient care under facylty syper" 
vision, with patients pre'Selectid for their 
Instructional yalye, 

t Seminar discyssions reqyirlfig stodents to riiiarch, 
present, and discyss'pirtinent 1nforiation> 

3, Assigned readings, 


•< 

i 

» - 


SySGOIlL 

Ths ^tljdint will dpvplnn ^^kill? snri knnwlpHne in 

clinical data gathering wltli anbulatfiry patients 
with DarticuUr reffirfiiice ts coinfln urablsM In 
doing thiSi hi will be able to; 


■ 


Given 1 new pitient/physiciin 
encouiiters, the student will 
satisfy tlie preceptor as to 
his aliility to; 


SKILL 






Objective I; Take a brief history of the 
1 present illness. 


1, See Overall Methods . 


1, like a satisfactory patient 
history. 


Objective 2: Perform a screening physical 
examination, 

i 

1 Objective 3: Utilize health care teain DerSDnnsl 
to ac^yire and record in a timely 
lannifj Ififomiation raprding thi 
1 . patient. 

i 

I 

M 

i 


t, The preceptor will; 

Dimonstrate sffective yse of health care team, ■ 
and provide fixplanatign of soynd practicei and 
potential problems, ■ 

1 


I Mm an adequate screenifig 
physical sm, 

3. Iiitfiract with health ears "teaiD" 
pErsonnel in gathering and re- 
otrding patient data." PreceptQr 
e'alyations will bo based on 
direct observation or review of 
video tapes and will ytiliie the 
"Interview Evaluation Gheckliit." 

22'i 
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L CLIIilCAL GOAL himt^jtm (Cent'd) 



,S! 



Acquire sMlli in patient intervitwing, Ihe 
itydint will be abli to; 

Ml 

Qbjettiya 1 i Estiblish and maintain. rapport with 
the pititnt. 

Qbjittiytl: Encoyroge and allow the patient to 
dgscribe problpi in his oi^fi terms. 

ObjiCLivi j> Ask "ppen^ended" questioni parti- 
Mtil to the ixprsiiid or suspicted 
probleini. 

QbjiCtivg 4 : DaniDnstrati an ability to ytilill 
' interviewing prindplfis is deicribed 
in "Skilli of the Mm] Intaryiow*" 

GbjecLive j i yriti a patient profile biied en i 
tiped patient intirviaw, 



SOEEaAL 

The itudint ^\]] davilop skills and knowledge in clintcal 
probleni definition* with priiriry ifiiptois on ambylatory 
pitier.ti suffering froi^ m^m probjams, [n doing this he 
will fct able to: 

Objective 1 ; Damonstrita his iwafenaii of which 
are the ten mi coion probliins, 



1. The pricipts will! 

Chooii appropriati patienti for the itudant to 
interview, byilding from simple to m^\m^ and 
pfovldi iKamplis of cofiofi intarviewing pfablafns. 



h Observe and critique the itydents' interviewing 
tichniqyis, 



3* Provide clear feedback to the stydant rtgarding 
his/her interviawing baliayjors, iffcets on othars 
and Qvofall coiiynication 

4, Demunstrate technifjuis which iri based en cyrrent 
icientifie knowlodp and ^^hicli work for yay* 

5, Diicyss openly with stydants the pros and cons Of 
virioys approachis in dialing with patientii 
considering the chiractefistici of the pitiant 
and thi phyilcian. 



The preceptor will: 



uiscuss 
and ideii 
practice* 



! stydint parti nint facts, concepts 
are cyrrint and riUvint to yflyr 



Given fi patient/physician trcoun- 
tars, !lia i^ydint wili satiify 
the preceptor that he can ci'ftct- 
ivi'ly apply the indicated inter-.. ^ 
parsorial skills in dealing vdth^ 
the patient, Prfcaptgr ivalyating 
will be based on direct ebsirva- 
tinns or review of video tapis of 
infoyntirs, 



Oi'^en a taped patient interview, 
(this (nay bo from a previously 
pparid'intarview selacted for 
iflyatlon pyrposei or nay be le- 
ler.teHrom any other loyrce), 
The stydeiit will writ! an appro- 
priate patitnt profili. 



1. 



Lilt from mamory eight Of thi tan 

Wt coiii^iion uiidlcai problaiiii. 
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\'A\kW\ 

llUllUlli 



(These prebleiiis were idgntified 
' , after Inoltintj at data frai the 
Hoyal CoUep of General Frac- 
titigners in England, and review 
of fainily physicuns' practices 
in tlie Stati of ishiiigtpn',) 

Objgetive h . State correelly tiii natyri] 
coy rig for aach of these pre- 
blems, 

Objaetive 3 : Stata correctly the diignsitic 
and tlieripeytic ticliniqyBS 
csranly ipplied for privifition 
and treitnisnt of these probleiiis. 

SKILL 

. QfajKtive 1 : Select appropriate data and 

justify his Silection of histor- 
ical, physical, and labpritory 
data in terms of eonon high- 
probability disiaies and cost 
effectiveniss. 

m 

The student will develop knowlidge and skill in 
clinical pronlli solving with ambyktory patiintl 
with pifticuiar refirence to ccgon problems. In 
doing this, iiewlll be able to:" " " 

Objective 1 ; Review initiil ififoriiiation 

gathered about the patient and 
inaka cost-effective deeisions 
as to which laboratory tistl to 
select in which logical ordir, 



Hcgyiint the itydent with available reseyrces - 
consiiltafits and literatyre • pertinent to com 
probleiiis. 

Point out clinical eKamples of these prgbliis and 
their natural course during the coyne of patient 
carii 

DeMnstrati techniques in diagnosii, treatment and 
previntioni 

i 

Give stydents feedback on yaor assessments of their 
fenowledge and ikills in context of clinical practice. 

Adequately evaluate the student 'i knowledge and 
skills it the end of the eourse, 
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Objectiva h Davalop an appfopriate differ' 
antill dlignosis ffpi tht affi- 
ciifitly iilactad data, 



1. See Overan Method 1. 

the preceptor ^ill; 

I Explain the ippropriati criteria for iound data 
col lection, 

I Oomitrite effectlva dati eollectton with isviril 
patienti, ifid explain ik ratlonili for the jydpints 
made. 



The.precoptor will: 

itydents qyestions dasigned to elicit logical 
thoyght in solving probleuis, 

I Follow a prgbleoi-solving lequinci in preienting ■ 
tim during confarencis* 

h Explain the rationale for your judgeffients to stydints 
in the coyrse of clinical work* 



t Given tiiree froin aniong the tin Mit 
conon loedicil prsblefuSi correctly 
discriiie their natural course, 

3i Given r,hree frsin aniong the ten nost 
coiion inedica] problenii, correctly de- 
icribi the cownly appliid duenostic 
and thorapeutic techniqyes for tligir 
prevDntion and treatmenti 



I Given a patient-pliysiciaii encounter ^ ■ 
selictiid by the priciptor and in- 
volvintj one of the ten .most coiion 
disaaia L^ntitias, the itudent will si- 
lect ajiproprlati historical, phyilcili 
and lib data and sitiifictorily jystify 
his lelaction to the pracaptor. 



L Given .1 set of patient data, the student 
will Si^lact apprppriata lab tasti in 
reasoniible sequence, and jystify se* 
lactioiiE to the priciptofi 



t ^ Oiven a coinprahiniivi sit of patient 
data siilficted by thi priceptor, davi'^ . 
lop an apprppriatf diffarential diignsdi "I; 
and jystify to thi priciptor. O ^g 



Priiiiary Care (Cci 



Oyjjtiysj; Mi ippropri^W decisiofis fa* 
" : gardingi 

a) Hospitilintion or contlnuad 
"Qutpatiant" traatment. 

b) Riforral or continued manage- 



e) nature of follow-up, whither 
by phone, fetufn appsintmentj 
dalayod callback, or use of 
other personnal 

d) Intarvals for followp. 

i) Riferril to apprDprUta 
specific apciis. 



mmi 



The stydent will acquire knov/ladge of, and iklll 
in, the m of the telephone in dalivirlng health 
carl. Ths student will be able to: 

Objective 1 ; Expliin the principles of tele^ 
phono [iiinageiiient of patients, 



1 |! Evaluoti the offoctivenoss of 
application of the key princi- 
_ples of telephone Mnagenient of 
patients by self and others. 

ij: Efuploy the key principles of tele- 
phone managfrint of patients vihin 
Interacting over the telephone 
Viith patients. 



ObJictivii i Explain the principles of effec- 
tlvi tgliphoni consultation, 



4, Ask the student to expUin his/her logic, de- 
cisions, ond rotigiiiile; and then critique the 
quality of tk judpent, 

I Mm the itudont's ricordi on historigi, physical 
mm, laboratory data and onioing minapinant; and 
discuss the plity of the student's judgints, 

5. Discuss the pros and cons reoarding hospitll Vi, 
oyt-^patient fnanageiiient of problems, and why, 

h Discuis instances in which it is adviiabla to . 
raeownd consyltationi and iy, 

8, Discuss and assist with the appropriate yia of 
referrals to other inedical disciplinis vi. 
contlnyed fninigeiiient, 

9, DiieuiS the appropriate interval and modi of 
fQllow-^yp using the phone and other personnel 

10, Evaluate and give feedback studenti regarding 
their clinical judgment and prableiii solving 

iei. 



The preceptor will: 



1. (Objectives h 4 and ?) Oiscuio with the itudent 
the coneeptyal and thegretical bases^ the lifnita- 
tlons and effectiveneiSi and the psychological 
rafnificationi of telephone fiiinigOTnt (1) tele- 
phone consultition (4) and tilephoEie riferral 

I (Objectives h 5 and 0) Allovi the stydent to 
obierve and critique the preceptor's telephoiii 
fr-anapinenti consultation and referral according 
to key principles and effectivenesSi 

3i (Objictivis 3i 6 and 9) 'Provide the student with 
opportynities to utiliii telephone fnanagenient, 
consyltationi and referral principlii, 



Oiven fl petients selected 
precipforj make the indicated de* 
cisions and justify theia to the 
preceptor. 



Orally, or in writing, explain the key pfin- 
ciples of lelephune minapnent of patients, 



L Oivin the appropriate patient chart and an 
audio tape of a telephonic physician/pitient:."; 
incounter, identify ipplicat1on(and miappTi-- 
cation) of telephone Mnagwt strittgy. 

I Given a patient telephonic inquiry and the v 
patient^s chart. Ihe student will deal with 
the patiint to the preceptor's satisfaction i; .- 
(thii be audio taped for use in 12 above), 

4 Orally or in writing, explain the key pri 
ies of tilephoni coniyltatisn of patient _ ■ 



J, ' ill ii. li''i<L!'i hill liiiji ill lyi i 



1 m> 



iii 
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L CLlfllWLGQAL Primary Care (Csfit'd) 

Qbjtctivi Si Evaluate efffictlvanass of tlie 
application of teliptiQni mmh 
tation prineiplis by islf and 
others, 



Cbjictivi 6: Employ kiy tilephsna consyltation 
prinoipleSi 



OSjictiva 7 : Explain the principles of affectivi 
tolaplipne patient rifirral. 



Objective 6 ; Evaluate iffectiyaniii of the 
applicitipn of telephoni patiint 
refirral principlai by self and 
Qthafi, 



Objaetlvi § ! Eoiploy kfiytelephona pitient 
rafarra] prineiplis. 



mmi ■ 

Tha itudint Mil devilop skill in tlia mintananci 
of clinieal ricords which aid in problafn solving 
and provida contiAyity. In doing thiij the stu- 
dint will bi able to : 

Qbjictiva_l i Orginiza patiant data so as to be 
able to coiiiiinicite it to othar 
health care personnei 
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The praceptsr will: 

1. Orient the itudant to the patient record keiping 
lysteoi in the offiee, 



Oivifi thu appropriate patient chnrt and 
an audio tape of a telephoniG physirian/ 
coiisulty.il ificoyntori identify applicatien 
(and oiiospplication) of tilaphona consyl* 
tation, 

i Given a patient problem requiring tela* 
phone corisyltitinn, the Etudent will re* 
^uest cQniultation via teliphone yndir 
direet sypervlsion of the praseptor {aydio 
tapes of tliii consylt luay ba used in 
I above.) 

h Orally or in writingt e)(plain the key 
principlos of effactiva talephono patient 
referral. 

Eiven th:: appropriate patient chart and 
an audio tape of a telephonic physician/ . 
patient enGoynter, identii^ applicition 
(and oilE^pplicatisn) of teliphone wnacg^ . 
fnent strategy, 



h Given a patient talephona in^yiry and the 
patiint'i charti the student will foaki an . 
iffectlv? referral to the preeeptor-i 
satisfaction, 

Givan a :oilection of unorginized patient 
data providid by the preeepior, tlia itydgnt 
will orginiia and present the relevant 
inforfnation to the pricaptor's satisfietion 
in such a manner that it will be; 



1* Clear and 
care perso 



rehensible to other hsjith 



nel 
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CUSIWLm: Prliiiai^ Care (Cont'd) 



Ofganili diti so ii to mut In 
fofsiulatiiig diagnsitic and thira- 
peutic plans 



Objeetiva 3 ; 
Objictive 4: 



Osi dictating eqyipnt 
in raeDrding patiant diti* 

Uii the tiliplioni in re^ 
cording pitlint data, 



The iiydofit will develop skill in prospectiva 
mVji\i of the health of his patisntSp This 
will include icqyring an yndiritanding of the 
priiieiplai or pravantiva eara* cgst banefitSs 
and the jdded motivation for such cargjin a pri- 
paid lyitadi, The student v/fll be able ts: 



Objictive, 



Explain the princlplii of pri- 
vintiva cara as applied in the 
HHO and fei^for-sarvica sattingsi 



pbjictivt E l E)^pUin the eost*binifiti of 
prevantivi care in a prepaid 
lystara. 



I Diisusi the proi and csni of his medical record: 
keeping system in the context of hii styli of 
practice, 



3, Riview the student's records and discuss the clarity 
and organization of data whioh iislsts in foriiiulating 
diagnoitic and thirapeutic plini. ' 

i Expliin his rationale for diagnostic and therapeutic 
plans and the forfmt he usas in recording this data* 

ii Assist the stydant in thi ippropfiiti use of the tela- 
phone as a iiiaans to obtiin olinlcil data and make 
midical diciiloni* 



L Discyii hiiith risks and medical intirvintions ^han- 
avir applicabli during cara prisentatloni/confsrenciSi 

. " "■ . ^ ^ 

I Ask tha stydint to oytTini health risks In issfleiition 
with patient tm in thi offici and hospitai, and 
-lyppllnient.JtyQent's knowledge by pointing out import 
tant risks, 



2rllJsefyl:in devalbping:it 
plani. 



Given f- pitiant-physician encountifs 
obsarviid or participated in by thi 
student, the student will prepare 
pititni's summarias acceptable to 
thi prrceptor using isch of thi . 
following methods: 

3. Dictating equipment 



4* Telaphcne 



Ofiliy (or in writing): . '- 

1, EKpliii! principles of priviittive wri' ; 
IS appiiid to fti-fof'Servici and 

HHO jettings,, , - , " 

2. iKplaiii Ehi.cflit-lenifits of privintive ' [ 
Ciri in i pripaid ptiiii. 



'imkm ?mr^ tm (Cont'd) 

Objective 3 i List II biiwi which 
" will tdto redyci thi 
I most ocMic health 
mmH> 



Uictivi ^ ! mm hii aetyal ixpiHincas 
at Group HiaithCogpintivi . 
and identify ipKlfic priven- 
tivi care praeticai k fin- 
54pd ifti 

liectivi^5 : Identify and describe ijsr 
health risks each pitient 
ineQuntsrid, 

SyOGQJll 

Povelsp a sensitivity to the psycho-iocia] im- 
pact of a diseasi on a patient and hii fiiiiily, 
-!?^^r^^M''^ of the phyiifian's respon- 
sibility, and tfeatnient approachis for dealing 
with thi impact* The student will be able to: 

#HLEDGE 



ive 
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uiscuss m the stydint thi 
ifficts of key h®ne Inter- 
actions on health. h0n 
which and how hu,in intipact- 
ions in the patitnt's iiiidiiti 
envirgnniint ire important to 
be awari,Qf in dealing with 
*hii health prsblM. 



Objeetlvil : Ejipliin the psychp-sgsial m- 
' pact of the | mit censn dl- 
seaies on thi' patient and his 
itiidiitt ledil enyifQiKit, 



3. Discyss methods of redycino m idintifiid dyring 
■■ Hie presentations, 



4. HelpthiitydentthinHhfoyghand ysemithodsto 
effictlvely redyci hialth riib In the conteitt of 
patient m = 



I Where possibli, involvi the itudifit in plionifig and 
diliygfifig pfenatyre eira. 



Ihi pfeciptorwini ^ ■ 

1, ipse the stydint thrgygh cise hiiteriiSi op'ng 
pitiints and silicted fMdIngi to the psyehgioeiil 
concomitanti of yarioys coisn diseasi entititiis, 




which will :tind^" '-"" 



3.- Llitil 

■ to reduce thi I most legneaiiE 
health care nl^s. 



4. iaiidoneKpirlencerinOroyDflMlth, 
identify Md.give the rationali, fgf ■ 
thi fl (sajor preventivi care praetiei 
at tiie facllityi ,, 



i (Given a patient'profili or chart) 
Oiseribe thil major health' fill!! 
, Mnfronting tR'i patient. ^ 



Orally (or in ifriting): \ 

1. Idontify a "signifiMnt" hyw inter, 
action iish can infriup en a pitiint 
sych that it affceti his hMlth and 
QffiFi a ratisnali for theiffict. > 



l/iit are thi If major psyehs-sodil iiii* 

pacti (any siTictid conn diiiiii} 
i yponthiprtiintaiid hisiiiediate , . 
enyironint? 



m 



■ . 



Objective 3 ! • iKplaln the ' physician' I raipan* 
, sibility and approacliii for 
' • •' ' dialing with psyche^iQciil \^ 
' ■ ■ pact of dlsiasi, 



&;.'..SKILL 



P OMietive I rtvaluate'finclingi ivailabil'for 
i pjtient and asiiss the psycho- 
/ ■•' . sodal ifflpict of his diiii^e : 
: '.; dn'tha pitiint hlmself aod tiis 
■ ■ iHifidia te social : invi rsiiint , 



$■ Objgctlve l i RiCOMd and justify triit- 
" ■■ ■ " Mt for the above didiloni, 



Qfajjetivi 3 ! Ostermine and discribs thi 
. ".. ...urpcy of the problini to 
thf patiint, his " 
8(id his cemntty. 



, ' lifldarstand the majsr differefieii batwaen a 
.. £fl3jr:gi)ity health can facility (luch ai an 
• .. .KflQ hospital 1 and a University affiliatid 
' tiaching settinij. The itydent will be able 



tos 



2. 'Critically d1iCuSi the currently artepted;idciai;iithie..:;/ 
regarding thi phyilcian'i riipenMbility'andiipp^ 
to dealing with the psycho-socialconconl tarts, of di-;:: 
seiie. ■ Fyrthir the precaptor shoyld oriifii the,ltudint 
to the varietf of. intra-and inter-hfiysi teicurcis for:::;: v 
hilping the pUiint with the psychQ-soeial cpnciiitantl., 



3, Familiifiiethg student with critical lipi' Of psychQ- ,v 
looiol distriii both disiasi specific and iiore ieiiirally . 
throygh casi-histOfiei and iglectad bibliggi^phiE rer ., 

^ ferraii.'.':,-"^:^.''' ' ■ 



4, Hodil and discyiiihs'cognitiva:prociss utilil^ 
, thfi^decision-iking irocesi figarding' thi ipprs- - 
priati treatiiiiit, ^ " ' ■'-.■v-.v, ^- 



i. mom with the student the yrgency.and dnruptim 
of spicial prflbletns and jodil appropriati.handlingi, 




. rwhen.dialinr-wH-h'thi/psycho^peia^ 

in8aci;-Sf..v.;r-v:^^;./!-5:-S:»i;:B>K^ 

(any selected coiisn' disease)?-;; 



l.( Given a particular chart or syra^ c: 
of findings) From the data provided ,^ 
what evidence do yeu find that this 
disease process is having an ifspact_, 
on the patient's social environ-.ent? - 



■L '(Given a particular chart or patiint 
sumry) froni the data provided: 

a) "recraend intervention for alliv-' 
' -iiting the psycho-social iipact, . 
of this disease on the patit-nt 
. and his invirsnsient. ' ' 

■ b) Of f?r a brief rationale for your y^j^ 
recisindiitioni. ' ' .[{^ 

I (Given a particular chart op patient 
surai.ary) Froic the data provided 
, ivaluUe the level of urgency. The 
psych3'Soeial iltment represents for.,Yr^ 

i) ' Tie patient 

b) T.ie family 

c) Tae eomninity 



'4 

4 



4 
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;:^ tetlvi] !'Listthe'feeydlffeTO 
' . in polkit!, procotoii 
§oals, and pfKtices 
tm^na corauiiity hoi- 
pital iid a tichini 
liospital.. 

■ %mn h OoscribHIii differgncM 
in pitient popylatioR, bQth 
, ifileri of mm: itm 

■ anyiitribytioHf ledical 
. , prcblii, km I csrannity 

■ \ iospita] and a tiachiog hQi- 
pital, 

jncreiiid iptols 00 priiry 
care in i coaoity tiealtli 
tm facility ( as corprid 
- toayfiivefsityaffiiiatid 
setting) fin phyiidin de- 
livered eare, " 




Tliipriceptorwill: ■.■ V ' / 

I Oidactically introdyce the student to tie policiii 
pracedyras, goali and practices Df the ccmnynity .. 
healih care facility. 



I Throyyh seleetid bibliQifaphlc'feferiRCii and didac^ 
Miynication iiitrodyce thiitydentts denopi 
eliMnts noted in objictivi 2. 



I Discyss with thi stytot the diftai 
' of priiry care in the t^iO iittinp and. thi'iifipli- 
cations for health care, 



y, :For iich^of'the followiiipiffl^gri|||^ 
. policies, P'ocedyres and 9oals/identiS';;!| 
fy the I wjor diffirencei kM^ a, .-, 
coraynlty i;id a teaching hospital, ■ . ; -ts 

.:^ y:y?::i 
Oriliy (or iii wfiting)! ' ' ■ 

I Describe' thi differeocesvin.patignt ^/f-rf 
pQpylation, both in tiriiisof:iec(iBiie,{,;.J 
stityr and ('istribytion ; of lidicill- ^ 
• probliSi:toeen acoiynltyiinda:', vv;-^ 
teaching hBipital^'.: ■ v; ;-- ^r;;; /-^ vv^i. 

Orally (or in writina) aniwir the^yestiwir" 

3, "iat iri thf iraplicationrof ■increaied'>^^^ 
• : .iphaiis i priiry care in,a .cCioonity ■:^55 
. V' health care iadlity]ai toiiipari^ 

yniyiriity I ffiliated Sittini) eii ''^■■g 
^" ^"'sician'dillvar^ carer ; ' ' ' x'^'^™^ 



■■■ .■ ■('■ 



■1 
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Mi 



mm 



i. ' ; CLIfilCfiLiiL. Cofl tinyity of C ari 

■ ■ Thg studijnt will gain knflwledgi mi iklll in 
pfiividing cciiipreticnsivc, CQntinuoys healtti 
'cars on a longitudinal basis. 

m 

yndarstand and praetics the .prlneiplei 
of CQntinuit^ of care, partiEuUpily 
within a closed niedieal cofflnunity. Ths 
student will bs able to; 



Objictivfil: Define continuity of cir4, 
" jongitudinal triatmant, epi-^ 
' iodic treitiTient and closed 
ir,edicil comrainity. 



Objeetive^i : Differentiate bstKafin longi* 
tydinal and ipiiodlc heilth 
care delivery, 



Objective 3 { Explain the wjsr eleMnti 
of continylty of care. 



Objtctivii : Oeicribe a closid mgdical 
coaTiUnity and its iiiiplfv 
cations to medical practiee, 



The prscoi 

1. Elaborati for/with the studant the operatianil 
definition of continuity of cara, longi' " ' 
treatmint, episodic treatment, ind cloiid 
medical coniunity, 



t During ths course of planning long-tirm hialth, 
carefor HI^O nieiiibers, clari.fy eleranti 
which differantiate this.pianning from that , . 
which ralates only to episodic. 



3. A) Identify the basic charactiristics of a 
closed radical comnity manifest at your 



During the course of health care deHviryi ■ 
Identify functions, pattirns and trends, etc. 
which are chingid by or i result of the 
csinunity being :Clasedi ■'' 



1. Define the tamis; , . 
■ CentinuityofCare 
: LDngitud|riil treatMt 
Episodic triitinSnt ■ 
\ ■ Cl osed nil caV coiiunity' 



Describe the fi isost important ■ 
diffeSiS- between' longitudina , 
and ipisodic health care del iv'iry. 



3. Identify the ti liiaior iltients 
continuity oflealth ciri and 
plain how :th?y impact u 
care aelivery. , 



4. iit an the isipHcationi to 
eire of i closed midical coi 



of 
ex- 



health 
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Coiitinuiti of Care (Cofit'c 

Objective s: Mm ikii^Urmi and 
■ lyilritiEl in delivery 
of long-terii! Mi\\ can 
. williin a closed prepaid 
Ciiiiynity and open fai-fsr- 
iirvici coiiunity. 

iiicjivji : Evaluate itytat'dslivirid 
care to the uimt that ■ 
principlai of practici in 
I closed idical tmmtf 
mi continuity of care 
yore pfoperly applied. 

SKILL 

Qbjictiyjlj Demonstfati at a laval apprs- 
, priflti to his training, di- 
livary of beilth care on a 
longitudinal baiii in a 
closed idlcal coiynity, 



Select patients whose nedical prsgress over time : 
tin hi reasonably pridicted and piniiit the stydint 
to iinaii their treatint with liniMW^^^ 
ovir the period of the clirkihip. 



I, to does lon^'ten^ heal til care is-;,' . 

livary differ betwiin open ffi-fsr*' ' 
: service arid closed prepaid idicil 

cpMnitiis?- ; 



6. Ivaluation of the student .dalivired 
c^re^ Identify the preceptor wiisse 
continuity of cart pFocisies witlilii 
a clesid idicircomnity wifi',.:; 
ippliidl ; • • ' 



]. Oiven fj pitients' charti selectid 
prior to Ihe clerhhip, and rt- 

'"'■"IponsilfilTtffQF'plann^ 

livirino reiiuired health eiri (within 
thijiiiiit of tlie student's liyil) - 
dyrfng thf c1er!(shipr thi studint . ■ 
Hill sitlsfy the pfeceptpr with re- 
spiCttohis 



A) kluate prief therapy 

Bj Develop a treatmint plan 

Cj Interact with thi patient / 

D) Hanap the appropriati therapy, 

: i.e. deliver the care 



er|c 



II,. PRACTICE mmkim aid mmi m (cont'd) : 

11, Provide soprt and coynisiing per- 
tinant to interpsrsonal rilatisnstiips, 

12, ^ervo as an effeetive roU wdel in 
liis felatioiis with office and tiolpi'' 
tal personnel, pears, itydenti and 
others, 

13, Serve as a role radel in his life 
style by providing tinifi for both 
profeiiional and personal respon- 
sibilities and interests. 

li %m his rationale for priorities 
and decisions in worldng out iqui= 
table professionil and personal life 

CQiTjn'' 



% Piscuss openly with th3 student the 
mii of medical practice* the comiyn- 
ity, and self which must be considared 
in establiihini reilistic plans for 
professional and personal life. 

% Piicuss the stydent's future career 
plans in terras of his/hir personal 
and profissional attriljutes, 



iinnAioiiM GOALS AiiiiiJEciwes 



1 



IflSTRUCTlOfiAL 



' II PRACTICE mmmm m mmBi mi (con 
: Ik 

Undifitand the principles of cost effec- 
tiveness ifi health cere daliviry Inclyding 
thi diffifinces topically found in a pre- 
paid sysMdit 

Tha student will bi able to: 

Objective 1 i Expialn the principles 
of cost-sffnctiveniis in 
health cira delivify. 



je£tiv .] 2i Dose ri be and ai^piain the 
diffarencas in the appli- 
cation of :cost iffect- 
iveniss principlai in health 
care delivery within I pra^ 
paid lystp. 



Objecti Vi lli Evaluati the cart pattern 
dillverid for a particular 
disease and patient, and 
diterntini if the dill vary 
was cost-iffictive, 



Instruct the stydint in the principlei 
of cDst^affictive piedlcine u applied 
in an HUO setting and in fas-for-sir- 
vlce practici. 

t Where you feel vnur cQit-effectivi 
practice diffiri frooi conventional 
practice, e)(plain how your pattern 
differs/ 

' I'lhy you mk tha differing manige- 

iiient decisions 
= How tne, patient benfiflti 
- How the group bariafits 

3, yhara thi itydent has dilivired ciri, 
show whare his care patlirn cbyld'be 
iTiora cest-effictivi ind rainforce 
pQiitively cDst'effectiva Mnagewt 
choice ysing the quiitlon in 11 abovi* 



Orally (or in writini); 

1. iit ire the prinelpiel ef 'mi- 
effectivs" health care dellvefy? 



t> How dsos the appHEation efcsit- 
efffctive" practici principliS 
differ in an Hl^O latting ffP the 
ipplicgiion in fie-for-isrvici 
practiea? 
kliD baniflts? 

Jlaii do the^ bins' 



3, A. .Given a pitiant to nanage, 

1. ap;ily nost-effective prin* ;/ 
d|iisi to the treatiiiit plan.: 

I, Jy^ti fy choice of pit lent mana 
geMnt on the biiis, of cost- 
effectiveness principles, • 
B, Glv8ii 3 pitiiiit work-up and ;^ 
symiry of ciri delivered 

1, iduitify whera coit-effective 
nisjsyres iiava bien corfictly , 
applied. 



I Identify coit-effictivl 
mrei which ceuld/shsuld have 
biin mid, 

3, Give i rationale for pr chaicis. 
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-life. 

INSTEUCTIOIU ^liTtlOOS . 



Ill mmym 

Tno stiidnnt will ooin tawl# of and 
skill ill dGuling with and using » 
^ynity rosoyrcai which nhu to health* 
Tha student wiii be able to: 

O bjictiva 1 ; Oascribi the major health haiards 
in the eofriiiynity. 

Q bjjrtlvij * Describe the appropriite role of 
the HHQ physician with riipact t9 
thiie hiiirds. 



Objeetivi 3 ; Identify esiiiitiil lypporting 
agencves and pfofissionals in 
(he conunity and their fynctioni 
as thsy relate to health eara, 



Objective 4: Kork with coMnity agencias and 
profsssionah in lypintiiig health 
cart dilivirid by the HMO/ 



The preceptor y/llli 

I Orient tha stydont to iiiajor cownity haalth 
hazards during the early part of the clerk- 
ship. 

2, Point out to the student ividence of coin- 
fHynjEy heilth hazards whan individual 
patients are affictad by them, 

3f Serve aa a rola iMdel through hii ictiofl 
toward the reduction of such hazards;^ 

4. Discuss cQntrasting roles taken by virioui 
physicians in the cppunityi evidencing 
the interplay between wmnity needs and 
tha physician's parsonal styieij taltnti 
and attidudai, 

5. ^cqyaint the itudent with tha use of dirac- 
tnries for strvica, fnadical and non^Hiidicali 

in tha coiiunity* 

6. Pnint out apcles ha ysas in patient care and 
tha prQcesies by which he engages their 
sarvjcas. 

?i AFk the student quastioni in tha care of 
patients which elicit ideas regarding which 
agencies might pmvida usaful sarvlGis in 



peci 



ireas. 



8. 
10, 



Acquaint the student with key piopli in tha 
coiiiunlty and thiir contribytions, 



Facilitate itudent contacti with theia parsonSi 
aspecially when an Isiue relates to pitient , 
cars or ipacific student project, < 

Facilitita student involvainant in coiiynity 
whare acticn is being tikin on behalf of heilth 
hizardi, 



IdantiFy liiiajof health haiards 
In the eoiiwity. 

i Describe the praiant roll 
of the M physician with / 
rispict to thesa hazardSi 

B. Is tills roll appropriite and ■= 
effective? Justify your 
response*. 

((he student (nay select a given 
comnlty health cire luiprt apn* - 
cy or one fniy be ipaclfical ly ^ 
assigned) I Describa the rolt of 
the - a gency' in the com* 
ijnity and tha means by whidi an ,r 
H-:0 physician can gain iccass for: 
augii:pndng the health care dilivifci 
ty HI^O riaiars. 

liith II lelictad patient{s) who.' ;:;, 
can benefit froiii coMity hiilth:> 
sarvlcai, the studint will lerve ■ 
as the M and patient's lilison ; ; 
and ftcilitata deli vary of the hall t 
care for thi patiant to the litllv; 
faction of the priceptofi 
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IfimSOAIS All) ilEJiCTIVH 



'i'iM will acquirs knovilod^s of and esipaHsnee 
faeiHtite a more \mmtl mm diclco dsclslofi, 



y^d^fitand the fynction, t'lsory, orgoniiatlenal 
struciiirti hfii Ispal and econpfilc aspscts of 
lilO's'find'fiiffariiitl^ts thssa fm fBe-for. 
servlis iystQ,'!i, 

ThO student v;i 11 bs able tB! 

ti::]l!L£D3E 

Ob faetiva l i Explain ornsnlEation-ll 

structurSi lao^l, Q conoid, and 

iidrini^trativo prlnQlplji and 
functioni of Hi'O's. 



f 



1, All (sbjictivfii slisuld havo riidaetis prcsen" 
titi 00 j Vlith JpprapH its iudlsvilual luprt, 

sithsr in larfja of ifiall pupSi 



Obi'Ctive 2: Explain the orga-ili/itl final 

stryctyrD, 1 final i seonpc, ann 
ad^lninrativo pHndploi and 
funetieni of tiie fQe-fer-ifirvlte 



4 



Ob jgcUve 3 ; Contrast the arganiiational strys- 
tyro, lipli iconoriCi ind ikw 
iitrativi principlis and fyfiCtiSfi 
of the M m tk fie-fsMerviee 



jictlve 4 ; Explain thi advifitogis and dis- 
advintiges to the coniyi^if of pre- 
paid oiedical sorvlce ind midieal 
iniyrancii 



Objactive^E : Coinpan thi adyantagii ind diiad- 
~ Vintages to the oonsuniir of pri- 

paid medici] mm vs. midicil 

insurinca, 



Qb jietive 6; Explain the pitient/phi^sidin 
Felitisnship in in P and a 
fea-for-semce sitting 



251 



Obsarvi the patient/phyilsian ineai 
Encountir patieiitl in in 



in in 



3. litiatare thedifftro!iCfs;::"; :> 
in organiiatiDnal stryctyrO|,;;; 
'Ogali sconDinic and Wiiiiri- - ' ^ 
^strativi principles and func* .' 
tions of thi HI'lQ's vs» lha fie- 
fsr^Sirvici lyrtef^^;^^^^ . ; 
Ihii miy bi fvajuated by; : , 

i Short aniwir (|yistioni 

B, Objictivi quistions 

C, Essay quistioni 

4, llhit arrthe advantagss and . 
iliydvantapW to thi mimf 
fif^prepatd msdical srvici and : 
medical insyranco? 

This may ba ivalyatgd byi 

A. Short answer qyiitions ; 

B, Objictivi pstioni. 

h Centrist tfig advantap and dis- 
advafitap to the coniyfflir of , 
prepaid liiedicaljirvici:^!.:-^ 
Piidical insufaneai-' 
; Thjijiiay be ivalyat?d byi^^ , - 
i Short iwr^qyiStioni 
B, . Objfctive pitionr 
L Essay qyestioni ; ■ 

6. iat is thepatiint/phyiiciin". \ 
rfilationship in an lliIO and 
^ fii-for-iervice systini? 
This may be fviluited by; 
L Short aniwir qyistions 
B. Qbjactivi questifini 
L Essay qyistioiis 

D, Providing thrstydent^ : 
thi opportunity to an^ 
eoyntir patients in thi ' 
K^D setting and obsifvi ;; 
thisi ineountersi ; 
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IV. HHO EXPERIEIiCE m (cont'i) , 

' Ob jective 7 i Contrast the patienl/pHyiician 

" " ' ~ " relationship In the ' 
f{)r«service sitting. 



vs, a fee- 



Objective 8 : Explain the advantages and dis- 
advantages to the ph^fsiclan of 
operatifig in a cDiisuiiiep-ryn 
drginlHtion, 



Obsarvi physicians opirating m a consymer-run 
organization. Dilivar health care in i coniuiier- 
run organiEation, 



jective 9 : Explain the procedures nieessary 
ts establish an HHO in a mediyra- 
sizad litropDlitin area in which 
such a ficllity doei not preiently 
exist. 



jiictive 10 ; Evaluate the adequicy of a 

proposal to iStablisli an KHO 
' .■ and jystify the evilyition. 



Pfovids a simulitid experiincfi where the student 
goes throygh the protidyres of establishing an 
HflO in a mediyn-siied uietropalitafi aria. 



Iviluite the proposal prepared in the simulatid 
expifience ibove and explain the evaluation, 



. |j};QE|{?FlllEfieEG3AL(ci)nt'£i.) 

O bjective 11 1 E)(plain tlie imm by which 
a consyier joins an IM, 



Objective 1^ : Explain the advantages ind dii- 
advantagei to the consyiir of pre* 
paid medical seryice and fee-fof* 
sarvici carei 



Ohiectivg 13: Gontfist'tlie idvantagei and dii- 
idvintagei to the consymsf of pfi- 
. paid medical lervice vs. fee^for- 
saryice care, 



Objictive 14 ; Explain the role and respsnsibili- 
ties of the physiciin in an M 
setting and in a fie^for'ServiCi 
group practici setting. 



i higctiveJj : Contrast the role and risponsibili- 
tiii of the physician in an H'lO 
setting and in a fie-fof-seryice 
pyp practici litting, 



Provide a simulated epriinee i^hich allowi 
the studant to go through thi prociss of joining 



an 



Observe the Mniuir receiving mt in a prepaid 
idical service facility. Deliver care in a 
prepaid medical servici 



Provide a simulated eprienci whieli allows the 
student to ba a consuiir in a prepaid serviei 
facility. 



Observa the physician practicing in an 
Dilivir health" cira in an HHO. 



11. Hiiwdoes I csnsoiir join an 

m ■ 

This may be evaluated byi 

A, Short mmr qyestioni' 

B, Objective qyeitlofis ■ 



13. 



Hhat are the liivantaps and ' . 

disadvantages to the coniymir^ 

of [irepiid medical sarvice 

and fee-for-iervice? 

This liiay be evaluated byi 
L Objective questions 
I. Short mm qyestioni 
L Essay quiitioiis , 

iat an the differences to 
the coniuiiier of prepaid mid" ,;. 
leal sirvice vs. fee-for- 
service caref , ■ 
This may be evaluated by; 

h. Ohj?ctive questisni 

i, SiiCft answer queitions 
■ 0, Essay pstions ,. 



li 



llhat is the role and respDni' 
illties of the physician in an 
Hf'iO setting and in a fee-for-^ 
service pup practice set 
This may be evalyated by; 
L Objective pstieni 
S, Short ansiffr (jijestions 
C, Esiay queitioni 



IE. iat are the differenciis in . 
thi role and respsriSibilitiii . 
of the phyiician in an W 
letting and in a fci'-for- 
service group practice settinp?.:, 
This may be evaluated byi 
L Objectiva pstioni 
I Short answer pi jj^Q. 
C. Essay questions ^,0^ 



Objective Ifi ! Explain the bihivior and m\t^il 

. ...... £gpjjy,^j^g ggljfjug hill t(l ^6 Of 

" ' • patients enroilad'ln IIXQ'S* 



m . • 

DivalQp knowlidge of thi ikills in those pne- 
tiu] fytyros and ^^sdicil praeticas which an 
ehifactifiitie of on uiing Groyp HDilth 
Cospiritive it Puget Sound is the fmu 

mmi H 

Undirstind the diff^rencoi bitween H[1Q-s and 
faa^fdMarvica sittings in tha yia sf thi 
tilephdne in delivaring health eari. 

Thi itydint will ba able to; 

Objictive 1 1 Difrerantiate" betwiin ik 
teehnipi uiid in talaphoni 
nianipent Df pitienti in fee- for 
iifvici ind pripald lettings. 



Obiirve b6havior and attttydas.of meinbiri 
Silking health can in an IIHO, 



Obsirva teliphoni migeiint of patients 1^ 
a prDpild setting, 

Practici tatiphQni manipent of patlinti id' 
prepaid letting, ' 



16, yhat ara tha behaviors ;and, 

attitudes of ineiiiban seeking ■ 
' health cara in an ItlO? 
This may be evaluated by; 
L Objective questioni 

Short ansive^queitiofiSv 
C, Essay qyastien^ 



"■k 



What are the differences bit- 
ween, tochniquni \mi in 
telephone nanageiiioiit of patientiV- 
in fii-for-ierviGf /ind prepaid'":', 
settingi? • . "-v.^^^^vrt 
Thii fiiay be evaluated by; ^ 
: ■ A. ■■ Objectivi qyesUoni 
3,.. Short aniwtr qierJons,;-^^^ 
L Essay ^queltiQns ^;^■4;■^:iJ/ 
0, Observing itudc-nts ipply'; 
ing techniqiii cf tela-.;;;!:5 
phona minipint of pat*^'* 
lints in the pripaid,:: >:t. 
setting, 



Objietivij r Differintlate bitv/ien use of 
' telophsfii consul tition in fee- 
fQMimei and pripijd settifip, 



Objective 3 i Diffirentiite beten telephoni 
patiint rifirrii in Mqt- 
mm and prpid iittlngs. 



• nmi M 

Uiidirstind the pyrposii srganlzitisnil Itry^ 
tyrti and fynction of M ifilk-in eintrpney 
siryiei offered at Group Hiiltti Goopiratlvi. 



Obsirvi tilephofie consultitions in i prepaid 
sgttifKj. Perform tflephone coniultitioiii in 
I pripild litting. 



Obiervi ttleplioni patient rififrals in a pripaid 
litting* Pifform tilfphone patiifit fifrral in 
I prepaid settino. , : ■ 



iv/ flKO EiPI'RIEtlCE GOAL (cent' d.) 

' The student will be 'abl I to: 

Ob jective 1 : For the wilk-in emergency service 

T" offered at Groyp Hialth Cosp- 

' erativi, sxpUin the: 
^ purpose , 

■ • organliational stryoturi 

- fynctisn 



mm H 

Undsrstsnd the ikills and problems Involved 
in the mmmi of the 1110 health cars tiisi 
in both proventlvs arid tharipiutie roles. 

The student will ba able to; 

Objective 1 : Befine the role and the res- 
ponsibilities of all profess- 
ionili para-professional, and 
non-profesiional liiefflbers of the 
Group Heilth health eare tiam, 




1. By didactic presentation, eisplain the purpose, 
organiiation and function of the wilk-in per- 
gency clinics. 

2. Provide opportunities for the student to observe 
the clinic in opflration ind; , , . , , 

. elicit (luestlons from itudent regirding 

the clinic . ' ' ' ' , , 
. respond to elicited or spontineQUi student 

questionsv 

3. Provide the opportunity for the itudent to , 
function within the walk-in emergency clinic 
to the livel of hii trilning, 



Didactic presontation of' 

the roles and responsibilities of various 
mDniberl of the health' can tem, e.g.i ■ ' 
the physician, physician asilstant, nurse 
praEti'tioner, nurse (both registered and 
practicii), nyrsing aid, lOciaVw^^ . 

ward clerks, etc. , ' , ; 

. mnageMnt Drinciplli such as deleyation of 

duties, oral and written reportino patterns, 

role and rosponsibility definitions, etc, ^ 
. conflict resolution stfategles such as active 

listening, "soynding boird", confrontation, 

non-di recti ve, etc. 



1, Answer the following el thsf.. 
in writing or orally to the ; ■ 
satisfaction of thi pfi'; :^^^^^^^^^^ 
■ ciptori ' . , . ' ■ 

, ,; Whit is thei . .. = ; 

- function ■}= 
of the emtrpncy wilk-in £lini% 



Define the role and rospo(!''.% 
,iib11it1es:of:the:fDllnMlng:;;:| 
health care tiaiii meites irJl 
' they are used In the W ; ; 
setting: : : ■ ' 
. (Select IS miny tMB .v^ 
■ fGenbifS as deiirid).-;-;^* 

Alternatei , - • ;. , ^ i • ;:v''v,^^ 
» Provide several role dts-" 
criptibns as. found in ;ihi;: 
specific H^13 setting ix- 1 
periencid by .the ltu^ant,;^ 
and require identification 
of the teani loeisbi;", • '^f| 
. Oiher niuUiplHhlce itiffi. 



QbjiEtiva 2 ; Dertrind ixplaiti the ratioflale 
, foriicli tiain iiaigr's posl' 
, ' tiofi in thi flrpiiatioiiil hier- 
3fcli^ of Groyp Health Coopirat^^^^^ 



Objegtlyg 3 ; Describe the major principlei of 
utiluing and managing a health 
• carHeani (liieluding nyrseSi sodal 

workers, et. al). 
Ob jective 4 ; Identify the most comon 
■ . - . Inter-pirional problii which can 
vslop In a hialth cafi tm 



jectlvai ! EKplaiii hew the X moit com 
Intefpersonai Jinagement prob- 
lii ifi a health care team Ein 
be pravintid and rectified. 



Objactivi SAi Evaluate a health care team de- 
liviring patient care and idint- 
ify interpersenal raanageiiiint 
prpblini experlencid by the tiaii, 

ii Recsiiend ways and give a ratifin- 
ale to rectify Identified Inter- 
persenal nanageMnt problm with- 
. , 1(1 a health cari tiiii, 



I Hhefi managing and utilizing the health care teaHj 

■ modil desired managerial bihavisr 
' "debrief" student on both what you did and ■ 

the rationale 

■ ask student to identify managerial stfitegiis 
you ipply and ast for a poiiibli rations 

3, Hake availabli opportunitiei for itudent to 
practiee jsnageoient of the hialth cire teaii aiid . 
then ask student to;' - [ . ' 

• Identify specific lanagerial itrategiii used 
: ' prsvide a ratienale for having selictid thi ' 

■ itratigy.; 

' evaluateiti efffictivenesi ' ^ 



1 



2. 0.sser1be the orginizitionil strye-5;$ 
tjre Qf thetiHO health eere 
and give a:one'sentence:ratiofii]e-:|| 
far the placement of, each (flr -j-'-M 
select ieiiiber(s 



I Discribe the I najgr prlncipliS 

for. the oi^nigient of the' hialth 

- cjre tiapi. ■ ■ : • :■ ■ ■■.^il- 
■■ ■ ■ ■■■■■■■ '■^ r-^-' 'r^fi^ 
' ■<'■!?■ 
i Identify '•4_ mii mtm, inter- 

iiersonal preblei which iffeet 

;ths health can team.. , 

5, For thg following comn isana-; ..-Jj 
.'jeriai probleis (select as mj '^ 
■IS desired); ' ' 
> #ipreveptivi Biisyres^iiHxIl 

he' tiM.;,- 
■ whit interventions can be 'vSI 

used?—— ■• :t 



ilaving observed a heilth cari- 
■;ea;:i in operation, to the sitis* -, 
faction of the preceptor the. 
student should; 
k Eviluite the patient earl 

dBlivered and identify.. 

intirpirional ipana^enent: 

probifirai.experiencid by. ■:•.!:■ 

the tea!!).; • ■ 
6, Recoiiiind ways and give a. v 

rationaie to recti fy'iden*'! 

tifled interpirionaVfani- :? 

gejient probleiii' within a-;;.' 

health care team. 
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■ OiWtrnti posltivi ittitudii towird HHO^S ii 
''ci^itm for hcalth.cifi diliyiry, as futyri ifoploy- 
^;'mt Sittings, and as training sittiniSp aftff 
f jxpesuri to HKO traini^ 

r'- . - • AFfECTIVE . 



Qbjeetivf 



Objictiva. h 



fig training in an 
Hi^Oi the studont dll 
feS})piid iqyan,y or mr-^ 
favprobly (cDopfed to pra^ 
training risponsesltQ^pi- 
tionnairi itfiiis aiifiiing 
attitudei toi^ird ti;!0'i as 
health carg delivery sys- 
tmi and ai poisibli futyri , 
eniplopnt lettinp. 

Far CQufSis taught at ievifil 
sites,, im of wMchJre illlO 
stttingSp itydent iiiian fitin^s 
Oil coune gvalyation que^ 
tlonnairas for thDSl lty= 
dents trained at HI'lQ's will 
equdl Of exciid the oiiin rat^* 
ingg of thoif trained elsi-^ 
whan on sycli dkensions li 
mm satisfaction, usofyl- 
mih and latisfictifln with 
instructor/priCiptor. 



io spicial instruetionai strategiis are nquifid. ' 
Instructloji li ts bi according to contint^prsicrlbid 
objietlvas writtin for the QOntent erei. ^ ■ 



]. Attitydinal invintoHiS' [ 
■ ippropriate to thi givin 
ccurse ars to be dtvelopid 
thrsugh thistydent ivsl-' 
uation proeiii. 



Student eourie ivaluattGns 
for PHtlti-site mrm to 
bi developed through tin 
studinl oval uation process 
aiid to bi usid in ail sitei, 
wherein tin curriouUr cm- 
poiiint is tayght. Itaii tD 
bi IS disignid as to allow 
fer itatistical analysis. 



SS:: iracnoit cms- aiiii mm 



1 



ly. fflll WlEflCE Gm (cont'd,) . 

;': .'^ QE jeEtive 3 ! For courses taiK 

= ■ , Hi's, stiiitats 

the cpyrsis epll^ or more , 
fivorabiy thin copf able 
■ ' CQufies on syeh difflensioni 

■>;■: as iportincD, satisfaction,' 

and instructer eoptenci. 
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Resource Paper No. 6 

CLINICM. OBJECTIVES FOR 
A PRIMLY CARE RESIDENCY IN INTERNAL MEDICmE * 

!• Interview Objectives 

2. Urology Objectives 

3. Otorhlno laryngology Objectives 
4# Ophthalmology Objectives 

5. Orthopedic Objectives 

6. General Surgery Objectivee 

7. Nutrition Objectives 

8. Dermatology Objectives 

9. Obetetrlca/Gynecology Objectives 

9A. Bibliography - Obstetrics /Gynecology Objectives 



From the Harvard University Pinal Report, DecOTber 1975 
Project to Develop Curriculm for Physician Training In ffilOs 
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ABBREVIATIONS 

Areas other than Internal medlcln 
The physlGlan will be able 
Given a series of statementa 
Select those which are true 



73 



1. INTERVmW OIUECTIVES 



TPWIiA 1:o: 

a. ^lline the basic steps and the substeps of conducting a medical interview. 

b. State the role of non-verbal cues in the mediciil interview and physical 
examimition. 

c. Use non-directive questions in the medical interviews as Judged by a 
senior medical observer. 

d. State the seven general questions that must be asked regarding any sjmiptoni. 

e. Adequately elicit historical information about the present illnesBj 
past medical history, family and social historyg and the review of 
systems, as judged by a senior medical observor. 

Givein a common presenting symptomj TPWBA to ask the pertinent applicable 
questions. 

TPWBA, as judged by a senior medical observor, to: 

a. Systematically examine a patient. 

b. Systematically examine major body regions/systems, appropriately 
applying the metliods of inspection, palpationj percussion and 
auscultation. 

c. Demonstrate the ability of applying historical information in performing 
a more specific physical examination. 

d. Verbally present. a case succintly and well, 

e. Generate a problem- oriented record* 

f. Use the commonly accepted classifications of diseases (e.g* the New York 
Heart classification). 
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^^0 

- 3 - 

UROLOGY OIURCTrVES 
Draft #2 



1. ^^ASfj^; nhgiit iiift nrmiomy ^ind function of llie genitourinary system, TPWBA 
Ifi KTWAT. 

2. TPWHA to- 

n. 01)1 nin :m ;idequa1e history rGferrniae to the Oil system ns part of the 

general reviuw of systems, 
b, Kystemntically examine, the CiJ system; the /idequ/my of whirh in to he 

jMdged by a senior medical observor. 

3. TPWHA to: 

a . Adequately per Form a urinalysis, 

b. Recognize common abnormalities of the urine sediment. 

c. Adequately collect, examine and properly culture urine specimens 
suspected of being iniected mth either bacteria or mycobacteria. 

4. GASOS about the following, TPWBA to STWAT: 

a. J-rotelnurin- 

b. Specific gravfly/ osmolality or urine, 
cs Urinary eled rolytes. 

d. (Ireat fniTie t'learance, 

e, HUN/creatiniTie ratdos. 

Intra venous and retrograde pyelography, 

Cystoscopy * 
h. Renal arteriography, 
i * Cystonietrograms , 

5. GASOS about locHl/re/^rred pain and gastrointestinnl symptomatology of 
urologic disease, TPWIW to SWAT. 

6, TI^WBA to: 

a. Describe common irrltntive genltourinnry symptoms and to list their cause fj^)* 

b. Outline the appropriate evaluation and treatment of irritative urologic . - 

Q 

gj^l^" symptoms in adults* ^73 



cu IjC'Scribe common obstructive genitourinary symptons and their cause, 

d. Outline the cippropriate evaluation oV obstructive genitourinary 
symptons in adults* 

7. (31ven ci pal lent with tlie following symptoms or rindlngSg TPWBA to list 
the common causes nnd/or outline the appropriate diagnostic stepsi 

a. Ifemnturla* 

b. Persistent pyiirio In men/women, 
c* Incontinence* 

d* Pneumoturiiu 

e. Acute ecrotal pain. 
{\ Urinary retention. 

g. Urethral discharge in men. 
h* PenL's chancre or wart* 

i. Hemospermia, 

8. TPWBA to describe the clinical Features and treatment of: 
a. Acute bacterial prostatitjs, 

b* Clironic bacterial prostatitis. 

c. Congestive prostatitis, 

d* Benign prostatic hypertrophy. 

9. TPWBA to list the Indications for elective prostatectomy. 

10. GASOS dealing with the diagnosis and managemmt of the following cmdltions 
TPWBA to STWAT: 

a. Acute and chronic urinary tract infection. 

b. Gonorrhea and lues, 

c. Orchitis/epididymitis. 

d. l^drocele/ varicocele. 

e. Renal/ureteral/bladder stones. 

f. Infertility, ■ 
Impotency, 

h. Torsion of the appendix testis. 



11. THWIsA to deRfrrnKi ihu pulliophysiology of urolithiasis with regard to the 
rrili! fil l 

b* Inf ect J on* 

c, Iinmobilization 

d. FfypercHlcemia* 
e% Hyperuricemia* 

12* GASOS about the management of suspected trauma to the genitourinary 

system, TPWBA to STWAT. 
1:L GASOS about the following, TPWBA to STWAt: 

a* The clinical courses of cnrcinOTia of the prostate. 

b. The therapy of carcinoma of the prostate, 

14. ' GASOS about the diagnosis and management of neoplasms of the kidneys^ 

bladder and testes ^ TPWBA to STWAT, 

15. GASOS about the medical complications of urologic surgei^, TPWBA to STWAT. 

16, GASOS about vasectomy, TPWBA to STWAT. 

17, TPWBA to suspect or recognise each of the conditions listed below, 

for each item, the physician will also be able to outline the appropriate 
therapy * 

a. Testicular swelling, 

b. Epididymal swelling* 

c. Renal carbuncle, 

d. Perinephric abscess, 

e. Prostatic abscess* 

f. Obstruction associated with renal failure or infection, ^ 

g. Paraphimosis, \ 

h. Torsion of the spermatic cord. 
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3, OTORHINOLARYNGOLOGY OBJECTIVES 
Draft #3 

1. Given an unlabelled diagram of the outerj middle and inner ear^ as well 
as the tynipanic rnembranej 'I'PWBA to label the indicated structures, 

2. TPWBA to obtain an adequate history re Perable to the ear as part of the 
general review of systems. 

3, TPWHA to- 

a. Systematically examine the auricle^ auditory canal and typanic membrane 
h* Recogni^.e perforations of the tympanic membrane* 

c. Distinguish between marginal and central perforations of the tympanic 
membrane* 

d. Describe the complications which may be seen with either a central or 
marginal drum perforation* 

e. Accurately record the results of this examination; the adequacy to be 
nudged by a senior medical observor, 

4, TPWHA to I 



a* 


Select for clinical use a tuning fork with an appropriate 


frequency* 


b. 


Properly use head mirrors of differing sizes. 




c* 


Properly use an ear speculum. 




d. 


I^operly use an otoscope including a pneumatic otoscope* 




e. 


Properly use a cerumen spoon. 




f. 


List the indications and contraindications for irrigation 


of the ear* 




Irrigate the ear. 




h. 


Remove foreign bodies ftrom the auditopy canal and be able 


to describe 




which of these must be referred for therapy* 





5. TPWBA tot 

a. Describe the principle of the Weber, Binne and Schwabach tests and be 
able to describe the expected findings in each test In conductive and 
iensorineural hearing loss* 



b. fjist the corrmion causes of COTductlve and perceptive hearing. 

nASOS about hearing loss secondary to external ear causes 5 middle ear 
causes and cochlear, 8th nerve or central causes 5 TPWBA to STWAT. 
^ d, GASOS about the el fects of hormones^ drugSj noise and aging on hearing, 

TPWBA to STWAT. 

6, TPWBA to list the common causes of tinnitus and otalgia. For each cause 
listed^ TPWBA to outline the appropriate therapeutic steps. 

7- TPWBA toi 

a« Define vertigo. 

b. List the cominon meanings of the term 'dizziness' as used by patients* 

c. List a series of questions which serve to distinguish between 
■dizziness' and vertigo, 

(1) TPWHA to list the canmon peripheral and central causes of vertigo, 

(2) TPWBA to list the characteristics of centrally caused vertigo. 
(31 TPWBA to list the characteristics of peripherally caused vertigo. 
(41 As part of the assessment of the patient with vertigo^ TPWBA to: 

(a) Measure the blood pressure in both arms as well as measi^ing 
the blood pressure In both the supine and standing positions, 

(b) Listen for bruits in the neck and upper chest 5 look for 
arrhythmias, 

(c) Bcamine the fundus for the presence of papilledema, 

(d) Assess hearing using* 

i. a masking maneuver 
11, the Weber and Rlnne tests, 
, (e) Assess cerebellar function by: 
i. testing coordination 
11, testing balance using gait and Romberg testing, 
(f) Assess nystagmus byi 
Q examining for the presence of spontaneoui nystagmus, 
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fl. inducing nystagmus vini 
opidkinetic testing 

positional testing (%ien-Uarnny maneuver) 
caloric testing. 

(g) Describe and elicit cranial nerve signs, brainstem signs and 
contralateral cort icoepinal tract signs, 

(h) Order the appropriate tests if an acoustic neuroma is suspected 
(5) GASUS about the following causes of vertigo^ TPWBA to STWAT.' 

(a) E^sbaric vertigo. 

(1^^ Ol;itic vertigo (including perilabyrinthitis) 

(c) ^^^perventilation^provoked positional vertigo. 

(d) hematologic and endocrine associated vertigo. 
TPWliA to : 

a. List those ftctors which may contribute to *the development of otitis 
externa (0. f:,) 

b. Describe the signs and symptoms of O.E. 

c. Ust the types of organisms that may cause 0,1!, 

d. Describe the di ff erences between OJU and otitis media (O.MJ, 

e. Describe the principles of therapy in 0,1;. 
TPWBA toi 

a. Describe the signs and symptons of acute 0,M, 

b. Describe the therapy of acute U.M. 

c. . Outline the complications of acute 0,M, 
TWBA to^ 

a. 'Vscribe the signs and symptons of serous O.M. and the factors that 
may lead to its development, 

b. List the diagnostic considerations in serous 0, M. in the adult presenting 
for the ftrst time with unilateral disease. 

TPWBA to^ ' ' 

2S0 
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n. Recognli^e mid re far patients with chroniQ otitis media, 
b, Irist the complications of chronic O.M. 

GASOS about the diagnostic significance of various ^pei of discharge from 
the ear^ TPWBA to STWAT, 

GASOS about viral and bacterial labyrinthitis, TPWBA to STWAT. 

a. TPWBA to describe the fiatula test and its aigniftcance. 

b. GASOS about diffuse and circumscribed bacterial labyrinthitis, TPWBA to STWAT. 

c. GASOS about the treatment of labyrinthitis, TPWBA to STWAT. 

GASOS about the pathologic process, signs and symptoms, and treatment of 
Meniere's diseasej TPWBA to STWAT, 
a* TPWDA to define recruitment, 

GASOS about the clinical findings In acoustic neuroma , TPWBA to STWAT, 
GASOS about the anatomy and function of the nose, oropharynx, and larymc, 
TPWBA to STWAT. 

THVBA to obtain an adequate history referable to the nose, oropharynx, and 
larynx as part of the general review of systems, 

TPWBA to systematically exmlne the nose, oropharymc, and larymc and to 
accurately record the results of this examination. The adequacy of this 
examination and record to be Judged by a senior medical observor, 
TPWBA to: 

a» Use nasal speculujn, 

b. Use silver nitrate sticks. 

c. Place an anterior nasal pack, 

d. Cheek foceosinophilla in nasal secretion- 

e. Check for glucose in patients with rhlno^^hea. 

f. Use laryngeal mirror. 

Use straight and curved bladed laryngoscope. 

h. Insert an endotracheal tube* 

i. Obtain transtracheal specimen for smear and cult^e. 



J. I^erlbrtii nrisotrnclienl suction. ' - 

Perform esoplirigoril intubation. 
TIVIJA to outline the diagnostic steps and management of patients withi 
a* !?;pis1;ax1s. 

b. Nasal congestion; nasal obstruction; nasal polyps. 

c . llyposmia , cacosmi a , parosmia . 

d. Burning of the tongue and mouth. 

e. Anterior neck pain. 
f% Sore throat. 

Hoarseness, 

h, Salivaary gland pain and enlargement. 

i. Globus, 

TPWBA to list the causes of stridor and for each cause state the appropriate 
treatment. 

GAS OS about common normal and abnormal physical findings or the orophaa^mc an 
neck, TPWBA to STWAT. 

Given a series of culture data fncm the nose/pharyrDCj TPWBA to state the 
appropriate action, 

GASOS about white or pigmented lesions of the oral cavity^ TPWBA to STWAT, 
TI^fiA to outline tlie therapeutic steps in the management of: 



a. 


Upper respiratory infections. 


b. 


Post nasal drip. 


c. 


Allergic/vasombtor rhinitis. 


d. 


Aphthous stomatitis. 


e. 


Oral tJirush, 


f. 


Pharyngitis including monopharyngitis. 




Peritonsillar cellulitis/abscess. 


h. 


Paratltis* 


i. 


Sialadenitis (including submaxillary gland). 



^ m - 

3. Laryngitis, 

k. Sinuaitia (including sphenoid sinusitis. TB/BA also to list the 
complications of sinusitis, 

26. TPWBA to recognize and treat i 

a. Cricoa^^enold arthritis* 

b. Acute epiglottis. 

c, Angi oedema. 

d, Ca.:6s' coronary 

27. GASOS about tumors of the oropharymc and la^tymcg TPWBA to STWAT. 

28. GASOS about the use of nasal sprays and decongastantSj TPWBA to STWAT, 
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OPm'lIALMOLOOY OBJECTIVES 
Draft *t4 

Given the following unlabeled diagrams, TPWDA to label the Indlcatad structures 

a. Sagittal crosa-Bectlon of the eye, 

b. TTie eyelids and lacrimal glands, 
TimA to I 

a. Obtain an adequate history referable to the eye as part of the general 
review of systems. 

b, Accurately record the results of the eye history and examination. The 
adequacy of this record and examination to be judged by a senior medical 
observor, 

TPWHA to I 

a. Correctly locate opacities or lesions located in the comeaj lens^ 
vitreous or ftindus, 

b. List the systematically examine the structures to be examined during 
fundoscopy* 

c. GASOS or fiindoscoplc pictures about normal and abnormal flndings of the 
disc, retinal blood vesselsj general fundus background and maeulaj TMBA 
to identify the true statements or recognize the condition presented, 

TPWBA to^ 

a. Detemlne visual acuity using either the standard or pocket Snellen chart. 

b. To check gross visual acuity via pinhole sight. 

c. Examine visual fields by gross conftontation. 

d. Test for color vision. 

e. Use a Schiotz tonometer and list the indications and contraindications 
for its use. 

f. Use a slit lamp for examination of the anterior chamber. 

(1) Use oblique iliuminatlon for detection of corneal abrasion. 
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g. Removcj foreign belies I'rom the lids or bLilbar con^junctlva. 

Apply an eye patch. 
±, Use sterile fluoreecein strips for examination of the cornea^ 
3. Do schirmer test, 

k. Obtain specimens from the conjunctiva for smear and culture. 

Given a patient who complains of a red eye 5 TPWBA to list and recognize 

those characteristics which distinguish these conditions.' 

a. Conjunctivitis. 

b* Iritis* . 

c. Acute glaucoma. 

d. Corneal infection or trauma. 

For each condition, TPV^BA to outline the appropriate therapeutic stepe. 
For each sign or symptom listed below, TPWBA toi 

a. List the cmmon causes of each sign/symptan 

b. State the appropriate follo™p questions* 
c* Outline the needed diagnDstlc studies, 

d. Indicate which conditions require referral to an ophthalmologist, 

e. Outline a treatment plan for the remaining conditions 1 

(1) SubnoCTial visual acuity* 

(2) Pain or discomfort of the eye. 

(3) Change of appearance cf lidss orbit or eye. 

(4) Diplopia* 

(5) Discharge from the eye. 

(6y Increase or decrease of eye secretions. 
GAS OS about the effects of aging on the eye^ TPWBA to STWAT* 
TPWBA toi 

a, GASOS about common abnormalities of the eyelids or e',nf .u;' r: n STWAT* 

The physician will also be able to indicate which of thtas < ondltions 
require referral to an ophthalmologist and be able to outline the 
treatment ^r the remaining conditions. ' . ^-285 



1^ Ciivon n patlunl suspeetcd of liavinK corneal Ibraign body or nbr/iBion^ 
TWItA to: 

(1) Measure visual acuity as the initinl step^* 

(2) Outline the diagnostic steps to be used, 

(3) Deseribe the treatment. 

(41 Recognize the early corneal infection and immediately refer patient 
to an ophthalmologist, 

c, TPWBA to provide emergency treatment of alkali and acid Induced 
conjunctivitls/keratitis, 

d. TPWRA to outline the emergency treatment of corneal or scleral laceration, 
TPWfiA to recognize tiie rollowing conditions and take the appropriate actioni 
a* hfeipetic keratitis, 

b. Corneal ulcers (especially due to pseudOTionas), 

c. ftrbital cellulitis. 

d. Central retinal arte^ occlusion, 

e. Chronic glaucoma (acute and chronic - see obj^ttS) 
f* Vitreous hemorrhage/ 

g* Sympathetic ophthalmia. 

h. Unilateral exophthalmous of recent origin* 

TPWIiA to recognize and grade the fundoscopic abnormnllties of i 

a. Arteriosclerosn s. 

b. Increased blood pressure (including malignant high blood pressure), 

c. Diabetes. 

GASOS or pictures referring to the ocular manifestations of systemic diseases^ 
the physician will be able to select those which are true or correctly identify 
the pictures. 
TPWBA to I 

a* List the commonly used mydriatics and their side effects, 
b. State when a pupil should or shouJ.d not be dilated. 

Estimate the depth of the anterior chamber by oblique lUunilnation, 
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(JASOS about the following, TPWBA to STWAT; 
n. Cyclopleglcs 

b. Drug therapy of glaucoma, especially interaction with other drugs. 

14. TPWBA to; , 

a. List the IndicationB and contraindications for the use of topical ocular 
steroids. 

b. List the complications that may occur with the use of ocular steroids. 

15. GASOS about the following, TPWBA to STWAT: 

a. The use of topical ocular anesthetics. 

b. Diagnostic dye solution, 

c. Lubricating agents. 

16. GASOS about eomnionly used topical ocular antibiotic preparations, TPWBA 
to STWAT. 

NEURO-OPHTHALMOLOGY OajECTIVES 

17. GASOS about the optic nerve and visual pathway, TPWBA to STWAT. 

18. GASOS involving the optic nerve or tract, TPWBA to describe the resulting 
visual field deficit. 

19. TPWBA to recognize optic neuritis. 

a. GASOS about the etiology, clinical ftndings and treatment of optic 
neuritis, TPWBA to STWAT. 

20. TPWBA to recognize papilledema and list the common causes thereof. 

21. TPWBA to recognize optic atrophy and list the coramon causes thereof. 

22. GASOS about the following pupillary abnormalities, TPWBA to STWAT-' 

a. Argyll Robertson 

b. Tonic 

c. Horner's syndrane. 

d. Anisocoria. 

e. Intracranial liemorrhage (thalamic, cortical, cerebellum, pons). 

^ 23. GASOS about gaze palsies, TWEA to STWAT. (frontal, occipital, lesions, brainstem) 



a. TWliA to recogiii^^e oculogyric crisis. 
TPWBA to clinically recognize paralysis of: oculomotors trochlear or abducen 
nerve* 

a, GASOS about the causes of paralysis of the oculomotor^ trochlear^ 

and cibducens nerves, TPWBA to STWAT, 
TPWHA to list three types of nystagmus which may be normally elicited, 
a. GASOS about pathologic nystagmuSj TPWBA to STWAT. 
TPWBA to define amaurosis fugax. 

a, GASOS about the etiology and treatment of those conditions associated 

with amaurosis fugaxj TPWHA to STWAT. 
TPWBA to recognise subhyaloid liemorrhage and state the significance of 
their findings. 

GASOS about the phaeomatoses^ TPWEiA to STWAT. 

GASOS about toxic/nutritional amblyopias ^ TPWRA to STWAT. 

GASOS about the ophthalmologic findings in migraine and related headaches^ 

TPWBA to STWAT. 

(blurred vision, scintillating scotOTiata, hOTOnymous hemianopsia). 
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ORTHOPEDIC OBJI-CTIVES 
Draft ttS 

Given a patient v?ilh a musculoskeletal disorder, TPWBA to elicit an 
appropriate history and perform a systematic physical examination. 
TPWBA to I 

a. Measure and record joint motion UBlng the American Academy of Orthopedic 

Surgeon -s criteria. 

State the normal range of Joint motion of spine ^ shoulders , elbows ^ 

\vrists, MCP^s, hips, knees, and ankles, 
c. Identic weakness in a major muscle group. 
GASOS about the following, TPWBA to STWATf 

a. The normal' and pathologic anatony, of the vertebral column and large joint- 

b. Normal synovial fluid. 

c. The synovial auld In inflammatory, infectious, degenerative and 
traumatic conditions. 

d. ITie natural history of a healing ftacture, bona, Xlgament, and tendon 
injury. 

e. The factors influencing the healing processes of bone, ligaments, and 
tendons. 

Given a list of major peripheral nervss, TPWBA to describe the associated 
sensory and motor distribution* 

Given a series of major spinal nerve roots, TPWBA to describe the associated 
dermatome. 
TPWBA to I 

a. Aspirate knees and bursae. 

b. Apply finger 5 ra'its, elbow^ ankle, and cock-up splints. 

c. Apply a sling to the upper extremity and/ or sllng/swarth. 

d. Inject bursae and tendons, exclusive of hip. 

289 




- # - 



e. clollGct properly and aiiulyvco ;joinl lluld approprl/itely uelng groae and 
microscopic teclmiques. 

f- Interpret bone filnis of the extremities for fractures^ localized 

demlnerallzation, subperiosteal resorption, cortical erosion, cysta^ 
osteophytes, and normal distribution of sesamoids, common anatomic 
variants, epiphyses (especially epiphyseal fracture), ■ ■ 

g- Identify common radiologic anatOTiic variants, 

lu Identlly epiphyseal ftractures, 

i. Stabilize iractiires to permit saft transport. 

j. Perfonn a digital nerve block, 

7. TPWRA to: 

a. Diagnose and treat ligamentous and muscular strains of the low back. 

b. Describe and elicit flndings in L5-S1 disc syndroraes. 

c. State when acute disc herniation representB a surgical emergency. 

d. List the causes for low back pain other than muscle strain and disc dlseaBe. 

8. TPWBA to: 

a. Clinically distinguish bursitis from arthritis, 

b. Recognize olecranon and prepatellar bursitis, 

9. for each condition listed below, TPWBA to take the appropriate measi^es 
as defined. 



MAJOR HEADINGS 

Neck . Shoulder . &Jaw 
Torticollis 

Cervical root syndrome 
Cervical disc 
Thoracic outlet syndrome 
Subacromial bursitis 
Bicipital tenosynovitis . 



Diagnose Only 
(treatment may 
not be needed) 
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Diagnose/Treat 



X 
X 



X 
X 



Diagnose/Re fe 



X 
X 
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Frozen shoulder 

Cuff/aupra apinatus tears 

Biceps brachii rupture 

Shoulder dislocation^anterior 

Shoulder dislocation posterior 

Acromio & sternoclavicular 
dislocation 

Snapping jaw 

Dislocation jaw 

Elbow . Wrist . i% Hand 

Dupuytren ' s contraction 

''early) 
Ganglion 



felon (Whitlow) including 
herpet ic in f e c t i on 

Paronychia 

Traumatic wrist injury 

Sprain & dislocation^ PIP, 
DIP^s 

Subluxatio: dislocation 
thuinb anci MCP*s 

Carpal tunnel syndrarie 

Calcific degenerative and 
inflammatory disorders 
of the wrist 

Tenosynovitis 5 suppurative 

Trigger finger 

de Quervain's tenosynovitis 

Traumatic tenosynDvitls 



Diagnose ftily 
(treatment 
may not be 
needed) 



Diagnose/Treat 
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X 

X 



Diagnose/Refer 



X 
X 
X 
X 
X 



X 
X 



X 

X (if not 
easily 
redueed) 



^->X 



f X (for re- 
currence) 



^7 



HMirn iii:a!jinc;h 



Mallet finger, Houtonniere 
deformity J profundus tear 

Tendon lacerations 

Olecranon bursitis 

Tennis elbow (epicondylitis) 

Stiff elbow 

Ulnar nerve contusion 

Ibrearm contusion 

Spine , Thorax 

Pectus carina turn 

Pectus excnvatum 

Tietze's syridrofne 

Costooartilage separatus 

Iractured ribs 

Acute lumbo-sacral strain 

Scoliosis 

Low back eyndrome 

Aseptic necrosis 

Trochanteric (deep and supe^ 
ficial) bursitis 

Fractures of the hip 

Slipped capital femoral 
epiphysis 

Knee 

Derangement of medical 
lateral menisci 
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lJi;i|4nose Only 
( treatment 

may not be 
needed") 



X 
X 



Ulugnose/Treat 



X 
X 

X 



X 
X 
X 
X 



Dingnosa/Ref 



if severe 



— -) X 



- w - 
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frgury of collateral/ 
cruciate Ligaments 

Rererred pain syndrome 
involving the knee 

Quadrlceps/patellar ligament 
rupture 

Chondroma la c 1 a 

Osteochondritis dessicans 

Subluxingj dislocating patella 

Bursitis around knee 

Popliteal cyst 



Ankle ^ Foot 
Flat feet 
Sprain ankle 
Cavus feet 
Metafarsalgia 
Plantar neuroma 
Peroneal spastic flat foot 
^terch fracture 
HalliDc valgus 

Halliix rlgidus 
HaniTier toe 

Achilles tenosynovitis 
Achilles bursitis 
Plantar fasciitis 



Diagnose Only 
(treatment 
may not be 
needed) 



DlagnoBe/Treat 
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X 

X 

X(pqsi 
X 



X 



Diagnose/Refer 



■—■^ X (if in- 
stability 
preser 
X 



X 
X 



■> X (if 
symptomatic 
or enp- 
larged ) 



X 
X 

X 



X 
X 



->X (if 
severe 
symptcwns ) 



->^X (if 
severe 
symptOTs) 



m - 



mum iii:aihn(ih 



IMantnr wart 

Plantar kercitosis 

Achilles rupture 

Plantaris .v gastrocnemius 
ruptures 



( 1 rani nifiTit 
nu\y not be 



IHii|4nnHi'/TrGa1 



/ 



X 



10. TPWBA to: 

a. Define osteoporosis, 

b. List the causes of generalized osteoporosis. 

c- GASOS about the clinical features and management of osteoporosis^ TPWBA^ 
to STWAT, 

d. Diagnose and manage osteoporotic vertebral collapse, 

11. GASOS about the clinical findings, complications and treatment of Paget 's 
disease, TPWBA '^o ST'WAT, 

12. TPWBA to: 

a. Detfne osteomalacia. 

b. List the causes of osteomalacia as well as the general principles of 
treatment. 

13. GASOS about the pathophysiology, clinical eymptoms^ and treatment of 
Pat embolism, TPWUA 1 o STWAT. 



29i 



ERIC 



- m - 

gi;ni;iial surgrry oiiJi:cT:rv!-s 

Draft #2 



1. GASOS about the natural history of wound healings TPWBA to STWAT, 
£1. GASOS about the adverse effects of various local and systemic 

factors on wound healing, TPWBA to STWAT, 

2. GASOS about antiseptic principles (including topical antiseptics, 
wound cleansing, prophylactic antibiotics and bowel preparation) ^ 
TPWBA to STWAT, 

a, llie physician will demonstrate adequate antiseptic technique in 
the management of a skin wound, the adequacy Judged by a senior 
medical observor, 

3. GASOS about wound infections and the infections associated with localized 
pathology (e.g. cholecystitis, diverticulitis, skin infection etc.) 
including regional and systemic differences In aora^ TPWBA to STWAT. 

a. tPWBA to outline a rational approach to the treatment of infection 
associated with G*I,, G*U. and Gyn pathology* 

4. GASOS about the natural history of thermal, electrical and chemical 
burns, TPWBA to STWAT, 

5. GASOS about the indications and use of tetanus prophylaxis^ TPWBA to STWAT. 
II. Techniques: The physician will demonstrate technical competency, as dudged 

by a senior surgical observor, in the following areas: 

1. Incision and drainage of a skin abscess, including the application 
of wicks to enhance drainage, 

a. Techniques of wound culture, 

b. Selection of appropriate methods of culture* 

2, Suturing of lacerations of the skin, excluding certain lesione of the 
face (especially around the mouth and eyes) and situations in which 
tendons, nerves and arteriee are involved. 
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;u TI'WHA t o describtj lliose inniirles whicli nrc at risk to heal with 

n cosniel i cnlly deleter lous scar and lience nood specirjlized treotment 
(Vom the otilsot (c,m. loaionft nljoutktho mouth nnd (jyes, flap and 
slullate lesions, etc,). 

TPWi^^A to recognise wounds that may be associated with tendon injury. 
Application of' dressings that are protective and secure. 

4* The selection^ use, and potential complications of local anesthetics, 
a. TFWHA to administer a digital block, 

5. Ikcision biopsy of skin lesionSj not on the face, and less than 1 cm 
in diameter, TPWBA to effect hemostasis in such cases- 

a. TPWIiA to describe an adequate preparatrion for a sigmoidoscopy. 

b. Tlie physician will demonstrate proi'iclency In the examination and 
the description of normal and abnormal findings as judged by a 
senior medical observor. 

c. TPWBA to list the indications for biopsy through the sigmoidoscope ^ 
the techniques f^or biopsy , the steps in handling materials , and 
the post biopsy precautions to be taken* 

IIL Management 

1. TPWBA to state the principles involved in and teclini(iues required in 
the management of: * 

a. Skin infections: cellulitis ^ furuncle ^ abscesses. 

b. 'itelons and paronychia (including herpetic whitlow), 

c. Ingrown toenail, 

d. Pilonidal cyst abscess, 

e. Human and animal bites. 

f. Ntonagement of clean and dirty, new and old skin wounds. 

(1) GASOS about the use of antibiotics in the management of skin 
wounds, TPWBA to STWAT. 
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.U. ly.cision of paplllomutnj sebaceous cysts and other benign skin 
lesions. 

h. rirst degree and second degree burns of the skin, involving less 
thnn 3% of the body surface. TPWBA to describe the principles of 
clinical staging of a burn. 

1 . Hemorrhoids , 

J. Stasis dermntitis. 

k. Splinters and small cut, foreign body. 

1. rish hooks. 

m. Puncture wounds. 
COLLAIiORATIVE MANAGEMENT 

Many ,of the conditions cited in the following sections involve collaborative 
medical management. Since the conditions generally present to, or are detected 
by the primary physician, an interface must be defined. Another very important 
objective for the primary physician in this collaboration is summarized In this 
very important objective.- given a list of the 10 most commonly performed 
surgical procedures, TPWHA to outline the physiologic consequences of the 
operation and the recovery phases postoperativelyj including complications 
(early and late) . 
I. Breast Masses 

1. The physician will demonstrate a systematic approach to breast examination 
as judged by a senior surgical observor, 

2. GASOS about the efficacy and applications of the findings from 
mammography (including thermography and xeroradiography) , TPWBA to STWAT. 
a. TPWBA to describe the appropriate action to be taken 'jsed on the 

results of mammography. 

3. GASOS about screening for breast cancer (Including high risk groups, 
self examination, periodic examination, mammographic techniques), TPWBA 
to STWAT, 
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4, Given a pritienl witli a breast nifiss (discovered on physical examination 
or momrnokrnpliy) 5 TI-WliA to outline: 

a. A dirferontial diagnosis based on age^ sux^ bizq^ and the presence 
of other reatnres (paln^ inflnmrnatory indices^ cyclicityj bloody 

d i scharge , etc , ) . 

b. TPWHA to perfonn a needle aspiration of isolated breast lesions, 

c, TPWHA to select those patients who are cancer suspects and should 
have surgical biopsy, 

d, TPWHA to outline the appropriate follow-up procedujfe for patients 
with breast abscess ^ cystic hyperplasia , intraductal papilloma 
and f ibroadenomata , 

6, GASOS about the presenting features , differential diagnosis and appropriate 

treatment of Paget ^s disease of the breast j TPWiiA to STWAT, 
Ttiyroid Disorders 

1* The physician will demonstrate an adequate systematic examination of 
the thyroid gland and associated lymph nodes ^ as judged by a senior 
observer , 

2. Given a patient with one or inore thyroid nodules or goiter. TPWBA to 
list those epidemiologies pliysical examj historic and laboriiLory 
features which favor each of tlie following diagnoses i 

a. Adenomatous goiter, 

b. niyroid cancer, 

c. Medullary thyroid cancer. 

d. Thyroiditis - acute, chronic, 

3. for each of the conditions cited in '^2", TPWDA to list the appropriate 
nianagement steps, 

4. Thyroid function testSj pharmacologyj Graves Disease; see medical objective 
Esophagus 

1. Given a series of patients with dysphagia or regurgitation, TPWBA to list 



the epidemiologic, historic, physical and radiographic feati^es which 
fVivori 

*i, AcJialasifl. 

Di ffiise spasm. 

c. Benign alricture, 

d. Tuniors, 

e. Diverticula* 

2. Given a series of radiographe illustrating the above conditions , TPWBA 
to correctly Identify them. 

rbr each of the conditions aited in "1", TPWBA to' list the appropriate 
management steps* 

4. Esophagoscopy-^Motility studies i see medical objectives 

5. GASOS about the anatomic and physiologic relationships In hiatus hernia, 
TPWBA to STWAT. 

a. GASOS about the clinical and x-ray features of hiatus hernlap 
TPWBA to STWAT, 

b. TPWBA to outline the steps in management of hiatus hernia, including 
indications for surgery* 

c. TPWBA to list the madpr complications of hiatus hernia along with 
their clinical features. 

6. TPWBA to list the presenting features and diagnostic steps In MaUory^ Weiss 
and Boerhaave^s syndrome* 

Stomach and Duodenum 

1. GASOS about gastric acid secretion including endogenous stimuli and 
exogenous stimuli (including test drugs )5 TPWBA to STWAT. 

2. TPWDA to list the indications for gastric secretoiy testing. 

3. TPWBA to list the steps In gastric secreto^ testing, pass a naso-gastric 
tube^ and collect samples for analysis, 
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Given several sets of data Crm gastric secretory testings TPWBA to 
correctly Interpret them* 

TPWBA to-list the epidemiologic ^ historic^ physical exbm^ laboratory and 
radiographic features of peptic ulcers (duodenal and gastric) ^ malignant 
gastric ulcers , acute and chronic gastritis* 

Given a series of radiographs illustrating the disorders listed in --S^j 
TPWBA to correctly Identify them. 

Given a patient with a gastric ulcer, TPWBA to list those features which 
distinguish benign from mnlignnnt , 

a, TPWHA to describe the role of each of the following in evaluation of 
a gastric ulcer f 

(1) secretory testing 

(2) cytologic study of washings* 

(3) endoscopy (with biopsy) ' 
(41 radiography 

(5) A therapeutic trial for healing* 

b, TPWIiA to outline the indications for and elements of a therapeutic 
trial for healing of a gcislric ulcer. 

Given a patient with a duodeucd ulcer^ TPWjiA to outlino an eflective 
therapeutic program. 

For benign gastric and duodenal ulcers ^ TPWUA to list the Indications 
for surger\ . 

a* TPWBA to describe the physiologic objectives for the various operative 
procedures for ulcere as well as their indications ^ success rates p 
and relative risk (short and long term). 

For benign gastric and duodenal ulcers, TPWBA to list the major complications, 

TPWBA to list the major historic^ clinical radiographic and laboratory ^ 

tests which suggest Zollinger- lailson syndrome. 



12, TPWhA 10 liHl the riiu:jor renturea of the ibllowin« post-gastrectomy 
HyudromoH, an well ns m/inagement steps i 
II. Jhimpin^ syndrorne* 

b, Nulrttional disturbances 

(1) megaloblastic anemia 

(2) iron de^^iciency 

(3) calcium deficiency 
(4^ steatorrhea 

c. Diarrhea 
Marginal ulcer. 

13. See also section on Acute Abdomen and G.I, Hemorrhage, 
Small Intestine 

1. Obstruction » see section on bowel obstruction. 

2. RE - see medicine 

3. Carcinoid Syndrome - see medicine 

4. GASOS about the Incidence, nature, and presenting ftatures of small bowel 
tujnors^ TPWBA to STWAT, 

5. Appendicitis. 

6. GASOS about the clinical features of occlusive and non-occlusive vascular 
disease of the bowels TPWBA to STWAT, ' 

Colon 

1* Ulcerative colitis - see medicine 
2 , Dl vert i culos 1 s 

a. GASOS about tbe physiologic basis of diverticulum formation in the 
colon, TPWBA to STWAT. 

b. GASOS about the effects of diet on the formation of dlvertlculae, 
and diet therapy In the treatment of diverticulitis , TPWBA to STWAT. 

c. GASOS about the presenting symptons of diverticull, TPWBA to STWAT, 
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"'^"^'"^ ■ ^' ' ^ 

d. riWHA 1o oiillfnc 1 liu H\opH in 1 1fu niudieal iiiiinn^emuTil of nuute 
tl I Vf?r1: Ic'iilJ 1 t K* ^ 

e. 'I'PWHA 1o daserilie ilw Jndicnllons for surgery in diverticulitis. 
Radiation Proctitis 

a, TPWBA to list the settings in which radiation proctitis occurs^ the 
effects of radiation on the rectum^ and the steps in the management 
of radiation proctitis. 

Villous Adenoma 

a* CASOS about the epidemiology of, the presenting symptone and syndromes 

of, the diagnosis and manngement of villous adenoma ^ TPWBA to STWAT. 
Cancer of' the Colon 

a* GASOS about the epidemiology of and location oJV colonic cancerSj 
TPWBA to STWAT, 

b, GASOS about the efficacy of stool examinations for occult bloody 
routine rectal examinations, routine proctoscopic examination and 
serologic studies In the early detection of cancer of the colon., 
TPWBA to STWAT. 

c* GASOS about presenting symptons of colonic cancer and especially 
the relotlon of symptons to location of the tumor, TPWHA to STWAT, - 

d. TI^WBA to out line the dlngnostic steps In a lesion suspected of being • 
carcinoma of the colon. 

Polyps 

a. GASOS about the epidemiologic, location and morphology of colonic 
polyps 5 TPWBA to STWAT. 

b. GASOS about the presenting symptons in colonic polyps, TPWBA to STWAT. 

c. GASOS about the malignant potential. of colonic polyps, TPWBA to STWAT. 

d. TPWBA to list the steps in management (indications for surgery) of: 
Cl"^ polyps less than 25 cm fran the anus 

(2) polyps elsewhere In the colon. 
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e. OASOS about the genetics, presenting symptoms^ and manageraent of 
familial polyposis , TPWBA to STWAT, 
7. Hemorrhoids \ 

a. TPWHA to describe the process of hemorrhoid formation and the structures 
involved. 

b. TPWBA to describe the diet management of a patient A^lth hemorrhoids. 

c. Stool softness - see medicine 

d. TPWBA to describe the topical therapy of hemorrhoida and its indications, 

e. GASOS about the indications for injection therapy and resection of 
hemorrhoids 5 TPWBA to STWAT, ^ 

f. TPWBA to describe an acute external hemorrhoidal thrombosis^ and will 
be able to describe the steps in management. 

(11 TPWBA to do an external hemorrhoidal cteombectomy. 
^ 8, Anal Fissure, Fistula^ and Papillitis 

a. GASOS about the presenting symptoms, physical findings, and medical 
management of anal fissures^ fistula and papillitis, TPWBA to STWAT. 

b, TPWBA to list conditions which may present as fissmres or flstulae 
in ano. 

VH. Liver . 
1* Portal hypertension^ varices, ascites. 
2. Jaundice "medicine vs* surgery"* 
VIII. Gall bladder and ducts. 

1, Oral and IV Cholangiography. 

2, Gallstones* 

3, Cholecystitis, cholangitis. 
IX. Pancreas 

^ 1, Acute pancreatitis (see medicine) 

2. Chronic pancreatitis. 

3. (^ats. 
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4. Tiijnors ( enrcinoma) for endocrine (see medicine U 

Spleen i 
1, Rupture. 

2* Splenectomy for hematologic disease. 
Hernias 

w 

Veins 

1. Thrombosis 

2. Varicose Veins 

3. Varicose ulcers 
Arteries 

1. Dissection of aorta 

2. Aneurysms. 
Lungs 

1. Bronchoscopy 

2. Tracheostomy ^ 

3 . ftieiiniothQrax 

4. Carclnomn lung 

5. Work^up of coin lesion, 

6. Scalene biopsy. 
Acute Abdomen 

1. TPWHA to obtain an accurate historical data base fifom a patient with an 
acute abdomen 5 Including the description of pains relevant GU and Gyn 
history, past Gl historyj vomiting etc., as Judged by a ienlor medical 
observor. • ^ 

2. Given a series of descriptions of pain patterns^ TPWOA to describe the 
likely underlying ^'^echanisms. 

» 

3. TPWDA to satisfactorily examine an abdomen including the palpation of ^ 
organSj percussion, detection of peritoneal slgnSj and auscultation of 

bowel sounds. 

^ a, TPWBA to accurately describe these Hndings as judged by o senior observor 



4. OASOS about: the fbllowing Inbomtory teats and their association with 
various acute al.idominril emnrge'icles, TPWBA to STWATi 

a. Ifct, 

b. Wnn, Differential 

c. Urinalysis* 

KUB and Upright, 
e* Amylase 

f. Wood light exam of the urine, 

5. Given a series of KUB^s foom patients with acute abdomeni, TPWBA to 
accurately identify dlati^bed patterns ind match these patterns to 
likely etiologies. 

3. Given the following list of common causes of the acute abdomen, TPWBA 
to describe the characteristic findings to be es^ected in each item of 
data base: 



_Causes 

Perforated peptic lacer 

Acute cholecystitis 

Acute pancreatitis 

Acute appendicitis 

Acute diverticulitis 

Acute gynecologic disease 
(ruptured ovarian cyst^ 
ruptured ectopic prenancy) 



Data Base Item 

Pain pattern 

Past clinical history 

agep sex 

VOTiltlng 

bowels 

menstrual history 
physical exam 
KUB5 upright 



Acute small & large bowel obstruction Urinalysis 
Acute renal or ureteral colic Hemogram 

Amylaie 

Upper Gastrointestinal hemorrhage 

1. TPWBA to list the common causes of upper GI hemorrhage in rank order of 
relative Irequencyi , 
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Vot eacli of the common causes described in XVl-l, TPWDA to state the 
features of histo^ and physical examination that favor that diagnosis* 
For each of the diagnostic studied listed, TPWHA to describe its role 
in the diagnosis of upper 01 bleeding. 

a. Gastric intubation. 

b. BSP 

c. NH3 level 

d. Barium lluoroscopy 

e. Esophago-'gastroscopy * ^ 

f. Selective angiography 

g. felloon tamponade ;: 
Assessment of blood loss 

a. TPWhA to describe the use of the following signs in assessing the ' 
voliune of blood loss. 
(1^ skin color 
(21 pulse 

(3^ HP recumbent and upright 
(41 CVP 

(5) urine output 

(6) stool volume and appenrance. 

"^The physician will construct a skeleton chart indicating the parameters to 
be followed in managing the bleeding patient, and the desired frequency 
of observation* 

GASOS about the objectives of trans fusion tborupy^ and parameters in XVI-S 
that Gf^ct tlie rate of transfusion, TPWHA to STWAT. 

GASOS about tlie application techniques and complications of the following 
methods used in the control of CI hemorrhage, TPWim to STWAT. 
a* lialloon tamponade* 
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b. Saline lavage 

c. Antacid therapy - 

d. Pitressln infusion 

8. GASOS about the role of the Allowing fectOTS in the decision foriurgical 
Intervention 5 TPWBA to STWAT. 
a. Patient*! age 
b* Patient's diagnosis 

c. Rate of blood loss and magnitude of blood loss 

d. Availability of canpatlble blood. 

e. Other lllneis. 

f/ First bleed vs. re-bleed, 
XVII, Lower Gastrointestinal temorrhage 
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7* NUTRITION OBJECTIVES ~ ■ j 

toaft #1 f 



GASOS about the digestion, abaoiption^ and intermediary metaboliim of protein^' : 
carbohydrate and fat, TPWBA to STWAT, 

GASOS about basic adult nutritional requirements^ TPWBA to STWAT, 
TPWFiA to elicit a screening nutritional history. 

GASOS about the physical findings in states of artered nutrition, TPWBA toTfWAT, . 
TPWBA to describe the major types of secondary or conditioned malnutrition 
and outline the principles oT therapy for each. 

Given a list of drugs that may induce nutrient deftclencles, TPWBA* 

a. To describe the mechanisms involved, and 

b. Describe the clinical effecta that may result. : : 
TPWBA to describe the limitations of short temi Intravenous feedings in 2 
providing total nutrltlOTal support. 

TPWBA to I 

a. List the Indications for total parenteral nutritional support, 

b. Correctly order hyperallmentatlDn solutions. 

c. Describe and manage the cOTipllcations/side effects of hyperalimentation, 
GASOS about hypervitaminosls A and D, TPWBA to STWAT. 

GASOS about the effects of malnutrition on infection and wound healing, ' ■ 

TPWBA to STWAT, \ _ " 

GASOS about diseases caused by deficiencies of individual nutrients and 
vitamins, TPWBA to STOAT. 

GASOS about macroelement and trace element deficiencies and excesses^ TPWBA to . 
STWAT, and be able to describe the steps in the management of each condition, . ■ 
GASOS about tube feedings, TPWBA to STWAT. ^ 
TB/BA to provide dietary couniellng in the management off 

a7 Diabetes mellitus " ' -ri 
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b, IlyperuholeBterolemia and hyperlipoproteinemia. 
Renal failure* 

d, nepatic railure. 

e. Congestive heart failure* 
f» obesity. 




DRRMATOlAKiY OHJIinTIVnS 
l)rnn lis 



TPWBA to I 

a* Elicit a history and perform a systemic examination in patients who 

present with skin problems, ITie cidequacy of this examination to be 

judged by a senior medical observer, 
b. Recognize benign lesions which do not require treatment found during 

the routine physical examination of' the skin, 
c* Describe the principle types of skin lesions morphologically and patho- 

physiologlcallyj and be able to distinguish prima^ FrOT secondary 

(excoriation^ patterns, 
d* Describe skin lesions in terms ofi 

(1) shape 

(21 arrangement 

(3) distribution 
TPWBA to: . 

a. Use in examinntlon of the skin a magniJylng glnss^ glass slide (dlascopy) 
and cross illumination. 

b. State the use of the drak field examination. 

Collect, prepare and examine scrapings from suspected fungal lesions* 

d. Use and interpret findings Irom Wood's light examination. 

e. Adequately sample lesions for bacterial and fungal cultures* 

f. Biopsy skin with a punch biopsy, 

g. Fbcamlne smears cyfcologically irom lesions suspectad of beings 

(1) herpes simplex/varicella/^oster 

(2) . bullous eruptions, 

h. State the application and indications of patch testing in the work- up of 
contact dermatitis. 
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1. state 11,0 usm of ult^iviolet lighi in dormnloloHiu therfipy nnd to 

l'« .-iliJe to advlHt' iii ilieJr proper use. 
.1. fiitret skin lesions. 

k. Use electrosurgical units as wall as cjn/otherapy. 

TPWBA to state the differential diagnosis and steps in the assessment and 
treatment of the following conditions: 

a. Dry skin, acquired icthyosis vulgaris. 

b. BuiTis, including sun reaction. 

c. Urticaria 

(1) GASOS about the pathophysiology of urticaria, TPWBA to STWAT. 

(2) TPWBA to list the cranmon causes of urticarln. 
(a) For each cause listed, TPWBA tor 

(i) state the elements of history and laboratory exam which 

support that diagnosis, 
(li) state the appropriate therapeutic steps. 

d. Prurltis 

(1) GASOS about the pathophysiology of pruritis, TPWBA to STWAT. 

(2) The physician will list those systemic illnesses which may present 
with pruritis. 

(3) Irom a list of common dermatoses, TPWBA to select those in which 
pruritis is commonly present and those which are obligate "itchers". 

(4) TPWBA to outline the appropriate therapeutic steps in the :maMgemint 
of pruritis. 

e. %perhidrosls 

f. Hyper-, Hypopigmentation 

g. Alopecia 

(1) GASOS about the normal physiology of hair growth and effects of 
various physiologic events on this growth, TPWBA to SI 
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(2^ TPWHA to describe the nlinical mnni rGstntlons nnd significance oft 
male pattern baldness, bnldness associated with cutaneous infection 
and other skin diseases ^ alopecia areata ^ trichotillomania 5 female ' 
pattern baldness 5 scarring and non-scarring alopecia, 
(3) TPWr^A to describe 5 for the above named conditions^ the appropriate 
therapeutic steps* 
h. Hirsutism va. Virilism 
1, Stomatitis 

j\ Commonly encountered nail changes 

TPWHA to identify the fbllowing disorders from a mixed graphic presentation 
or patient populationj and willte able to outline a diagnostic and treatment 
plan consistent with those described in the Nfanual of Dermatologlc Therapeutics , 

a. Disorders of epidermal proliferation 
(1^ psoriasis 

(2) pityriasis rosea 

(3i seborrheic dermatitis 

b. Sebaceous 5 eccrlnej apocrine glands 
{X^ acne vulgaris 

' ' (2) miliaria 

(3) hidrndenitis suppurativn 
(4") acne rosacea 

c* Hullous disorders 

(11 1), multiforme = 

( 2 ^ He^et i Tonn i s 

(3 Pemphigoid 
d. llcgematous dermatoses 

(11 allergic contact 

(21 atopic 

(fi) mummular ec^.emn 
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(4) dyshldrotio eo^ema 

(5) elasls dermotitii 

(6) lichen simplex ehronicus 
Primary disorders of skin and mucosa 

(1) aphthous ulcers 

(2) granulOTia annulare 

WBordere due to physical and chemical agents. 

(1) thermal burns 

(2) sunburn - 

- ' - • 

(3) phototcjDclc and photoallerglc reactions 

(4) fTOsibite 

g- Disorders due to microbial agents 

(1) impetlgOs ecthyma 

(2) folliculitis - carbuncle - cellulitis ^ erysipelas 

(3) erythrasma 
(4^ candldiaais 

(5) fiingal infection (dermatophytic, sporatric, etc.) 

(6) versicolor 
(7> IL simplex 

(8) \l zoster 

(9) molluscum contagiosum 

(10) verrucae c, accuminatum 

(11) rocky mountain spotted fever 
Diseases due to arthopods 

(1) mites - scabies 

(2) lice 

(3) Insect bites 
Corns and calluses 
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CMOS about: the pathophysiology and clinical charncteristics of malignant 
pigmented skin lesions, TPWBA to STWAT. 

a. Given a brovm or black pigmented skin lesion, TPWBA to recognize those 
characteristics of color, shape, and toppgraphy which may indicate 
malignant change. 

b. Given a broi^ or black pigmented skin lesion, TPWBA to refer for 
treatment those pigmented lesions suspected of being malignant. 

c. GASOS about the clLnical epidemiology of pre-cancerous skin lesions, 
TPWBA to STWAT, 

(1) GASOS about the clinicopathologlc correlations in pre-cancerous 
skin lesions and early squamous cell carcinoma, TPWBA to STWAT, 

(2) Given a series of photographs and case material demonstrating 
skin lesions which may be malignant, TPWBA to select those which 
should be referred for biopsy. 

d. GASOS about cllnicopathologie correlations In basal cell carcinoma, 
TPWBA to STWAT, 

TPWBA to diagnose and manage those treatable diseases which cause acute 
febrile illnesses associated with a rash, 

a. TPWBA to identify Prm graphic material and/- Ment presentations 
the following dermutologlc manifestations o!^^ systemic Infection, or 
will be able to describe the necessary diagr istlc steps required to 
differentiate among diseases luiving similar skin lesions: 
(1^ Rocky hfountaln spotted fever (differentir diagnosis to Include 

meningococcemla and measles). 
(2) Viral exanthems (macules, papules, vesicles, pustules or petechlae) 
with the differential diagnosis to include the following categories 
(a^ Petechlae ^ meningococcemla, bacterial endocarditis, 

rickettsioses, drug eruptions, any severe sepsis, many enteric 
viruses, hematologic disorders. 



(h) Mam.las: typhoid fever, scarlet fever, drug eruption, 

infectious hepatitis, infectious mononucleosis, rubella. 

(c) Papules I syphilis, drug eruption, rubeola rubeUa, many 
enteric viruses. 

(d) Vesicles or pustules.- staphylococcemia, gonococcemia, 
rickettsialpox, drug eruption, zoster, varicella, herpes 
simplex, vaccinia, many enteric viruses, 

(3) Using the categories in (2) on the previous page, characteristic 
morphology and distribution of lesions and epidemiologic data 
obtained from the patient or patient's family, TPWBA to select 
those statements which correctly Identily; 

(a) Hand- foot-mouth Disease 

(b) Herpes simplex 
Cc") Herpes zoster 
(d) Varicella 

(4^ Molluscum cont agios urn 

7. TPWriA to list the most common morphologic patterns that may be seen in 

Q-rug eruptions. (exantham, urticaria, eczematous lesions, 

photosensitivity reaction, purpuric) 

a. Given a list of commonly used drugs, TPWBA to describe the common type(s) 
of drug eruption(s) that each may produce. 

b. TPWBA to recognize and state the significance of the following lesions i 

(1) splinter hemorrhages of nails, osier's nodes, Janeway's lesions, 
tender subcutaneous nodules, cutaneous infarcts, nodose lesions. 

(2) ecthyma gangrenosa 

(3^ scarlitini form eruptions in patients with pharyngitis. 
(4) palpable purpura 
e. TPWBA to clinically distinguish a purpuric lesion from telangiectatic lesions. 
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(I I Tl'WItA lo rac-0|4riiv5e and slate tliu sifgni Ciicunco of the rollowing 
types of purpuric lesions: 
(a ) petechiae on mucosal membranes 

purulent purpura 
( c ) purpura fiilminans 
(d) palpable purpura 
(el psychogenic purpura 
(f) eyelid purpura (facial/upper torao) 
ig) perifollicular purpura 
(h) progressive pignientary purpi^a 
(1) pinch purpura 

d, GiveTi a list of skin lesions that rnay be associated with malignant disease 
TPWBA to describe each lesion and state the associated tumor(s)* 
TPWBA to describe and recoguize the skin maniftstations of rheumatic fever 

f, TPWBA to list those disorders associated withf 

(1) focal cutaneous hj^er and hypopigmentation 

(2) generalised cutaneous hyper and hypopigmentation 

(3) palmar erythema 

(4) telangiectasia 

(5) yellow skin 

(6) erythema multiform 

(7) intermittent flLushing of the skin 

(8) Raynaud *s phenanenon/acrocyanosis 

(9) clubbing and ridging of nails 

(10) cutaneous angiomatosis 

(11) calcification/ossl ft cation of the skin and subcutaneous tissues* 

(12) oral lesions 

(13) skin ulcers 

(14) xanthoma ' ^ 



Ibr each category of treatment/drugi Hated below, TPWBA to listi 

a. indication and contraindications 

b. the most errectlve agenti 

c. ^ their relative cost . 

d. their chief side effects 

(1) acne preparations 

(2) antihii tamines 

(3) anti-lnfectlve agents 

(4) ant i- inflammatory agents 

( 5 ) antiperspirants 

(6) antipruritic agents 

(7) cleansing agents 

(8) cosmetics and covering agents 

(9) depillatories and removal of excessive hair 

(10) dermatologic topical preparations and 
vehicles 

(11) insect repellants 

(12) keratolytic and destructive agents | prepara- 
tions for psoriasis^ seborrheic dermatitis 
and other scaling eruptions. 

(13) pigmenting and depigmenting agents, sunscreens 

(14) wet dressingi^ baths and astringents 
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1. TPWBA to elicit an accurate obstetric and gynecologic hietory as Judged by 
a senior medfcal observor. 

2. TPWBA to perform and accurately describe n pelvic examination including 
Inspection of external genitalia ^ speculum exam of the vagina and cervix^ 
bimanual baginal examination of the uterus and adnexa and rectovaginal exams 
on normal and abnorinal ndult patiunts| the adequacy oT this examination to 
be n lodged by a senior inedncal observor. TWi^A to ddstlnguish normal ftom 
abnormal findings. 

3. TPWBA to^ 

a* Collect, prepare^ examine and interpret a vaginal wet prep (ineludlng 
Swartz^Lamkin stalnl and KOH prep* 

(l) TPWM to recognize trlch. vaginalis ^ yeasts clue cells , 

b. Prepare and interpret a cervical gram stain* 

(1) TPWBA to recognize gram negative intracellular diplococci and polys* 

c. Collect adequately and handle (planting on appropriate media when necessaiy) 
cervical^ vaginal, and rectal specimens for bncteriologic and ftmgol 
culture . 

d. Adequately collect vaginal pool scrapings ^ endocervleal swabs 5 and 
cervical scrapings 5 prepare slides ftom such material and fix appropriately 
for cytologic examination. Jte/she will be able to take appropriate 
action based on cytologic evaluation. 

e. Describe the indications for cervical pool scrapings and vaginal pool swabs* 

f. Accurately perform and interpret a cervical mucus arborization test, 

g. Instruct the patient in performing a basal body temperature chart, 
(1) GASOS about the imT chart, TPWMA to STWAT. 

h. Instruct patients in the collection of specimens for HCG (pregnancy)* tests. 



OABOS about the teniporal fientures; sensitivity, nnd specificity 
of pregnancy (HCG) tests, including R sub-unit assay, TPWBA to STWAT. 
4. TPWHA to collect an adeyuota subdective and obdective data base and outline 
^''^^^^''^ ^J'^^^^^^^ management of the following 
Situations: (the level of analysis and hence point of reteal will mm^m^ 
be limited by the physician ^s technical skills see 3 J 

a. Missed period (suspected pregnancy) 

b. luncti^al menstrual disorder (secondary) Including amenorrhea, eKcesslve 
or irregular menstruation, and hypomenorrhea. 

c. Primary dysmenorrhea, 

d. Secondary dysmenorrhea. 

Premenstrual tension. ^ 
f. Vaginal discharge . 
Infertility. 

h. Galactorrhea. 

i. Perineal prurltis. 
d * ^spareiiula . 

k. Post^menopausal bleeding, 
1. Lump in the breast, 
m. Stress incontinence, 
n, DBS exposure, 
o. Venereal warts* 

p. Mastodynln. . , 

Wliite lesions of the vulva. 

5. for each of the Pollowing disorders, TPWHA to outline a diagnostic and 
treatment plan: . 

a. Gonorrhea and syphilis, 

b. Acute and chronic pelvic inaammatory disease. 

c. Bartholin's cyst. 

ErJc ^' Vaginitis (acute, chronic, atrophic) . 819 



GASOS about the physiolo©^, diagnosis and management of the menopause^ 
TPWRA to STWAT. 

TPWHA to take a sexual history that will be adequate to: 
a. Etetermlne dissatiBfaction 

Given dissatisfaction, will allow the appropriate referral to be made tc 

(1^^ marriage counselor 

(2) psychotherapist 

(3) sex therapist 

GASOS about the application and limitations of various methods of contra-^ 
ception, TPWBA to STWAT. He/She will be able to outline a teaching program 
for patients, ability to prescribe, and the stages in follov^up for the 
following methods* the pill, condom, diaphragm, lOD, cream, foam, jellies, 
rhythm, coitus interruptus, sterilisation, and the morning after piU, 
Given a series of common "minor" pill complications, TPWBA to outline a 
rational approacli to manipulation of various types of BCP's. 

a. Pill composition 

b. Side-errects of estrogen and progesterone predominance, 
(aven a list of drugs commonly used in pregnancy, TPWIM to select: 

a. Those which are toxic to the fetus. 

b. Those which are toxic to the mother. 

The physician will demonstrate an understanding of the mad or physiologic 
alterations of pregnancy and the interactions between common acute and 
chronic medical conditions and pregnancy.' 

nie physician, GASOS about the presentation of ectopic pregnancy, will be 
able to STWAT, 

GASOS about tlie clinical pre sent.it ion of ovarian and uterine malignancies, 
TPWHA to STWAT. 

GASOS about the clinical presentation of ovarian cysts, TPWBA to STWAT. 
GASOS about therapeutic abortion procedures, evaluation, risk assessment, and 
follow-up, TPWBA to STWAT. 
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pictures explaining how to). 

Nelson, J*H. i Clinical evaluation of side effects of current 
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mo Ciirriculum Duvelopmants Some Relevant Instructional Rosources 

Arthur S. Elstcln and Jack L, Moatsch 
Michigan State University 

ABSTRACT 

The use of Health Maintenance brgfinigations ^0 and other 

ambulatory care settings for undergraduate medical education poses 
n challenge, eincc an educational eKperlence should not disrupt the 
care-giving miBsJon of the organization, A number of simulation 
techniques arc avallnble that can help students improve their clinical 
skills outride tlio practice setting so as to facilitate effective 
and efficient use of the clinical eKperlence, These incliide: use 
of simulated or actual patients to train students in history taking 
and communication skills; a variety of simulation equipment for training 
in different portions of the physical examination^ clinical algorithms, 
flowchnrtSj nomputor-based or paper=and=pencil case simulations, 
and hii^li^rjdcility slmulntion gnmos, all for instruction in complex, 
soquantinl problt^m Holvlng, The techniques are briefly described, 
and poHnJble usen In thn medicnl scliool and mO are suggested, 31 
rcfercMicoii, 



Ifl^O Currlculuiii DBvolopment : Some Rolevant Instructional .Resources 

Arthur S, ElsCcln and Jack L. Maatfich 
Michigan State University 

Health Maintenance Organizations (HMO) are gradually becoming a more 
common orphan Lzationnl format in the American health care system, Accordinglyi 
attention in boinp, focused on mechanlHms for iirovidang medical students with 
clerkship cxpnriencu in the IfMO to acquaint the next generation of pliyslciana 
with prepaid group care and to assist in recruiting staff for the new' organlEatlons 
(1)» RenewGd interest In primary cara has also emphaslEed the desirability of of- 
fering primary care experiences to the medical student* the }M0 has been Identified 
as one possible learning environment for this experience. 

However 5 ambulatory care settings^ whether prepaid or f ee-f or-'Servlce enter-- 
prises J challen|»e undergraduate medical education in some ways not at issue 
with inpatient care. Patients in an HMO are not available and Idle for large 
b]ocks of time during wlrlnli they are reLitlvcly free for a leisurely approach 
to n prohlLMn, 'I'hc^ modicnl student; must learn to work rapidly ear.lier in 
his nareer tlinn haH previouHly bcpn the case* Furthurmore, the economic soundness 
of tlie WO LH predicated upon provision of prompt; and efficient service, 
Strntogics dovolopcd far coping with teacliing costs on inpatient services do 
not appoar to be dirGctly appiicnble since there Is no third-party payer to provide 
an ever^-lncrcasing day rntn. For these rensonSp WO managers and directors are 



appropriately concornccl Lo provide educatloiiol GxpariencQS, especially 

in primciry care, that are eff icientp cost effective, and do not disrupt ; 

the care-p,iving nisslon of the organization. 

How^cnn tnedical students be helped to fit into this new learning ■ V 

environmont early in their training and without an unreasonable eKpenditure 
of time and effort of IIMO staff? This paper will outline a number of 
available instructional techniques that can help medical students (and V 
residents) practice and improve their clinical skills outside the mO 
setting so that their usefulness within the setting can be maximized. Each 
of these techniques Is presently employed in several medical schools in 
North America though they have not yet been brought together in an IMO 
training package to our knowledget The discussion will consider interviewing . 
and history-taking skills^ competencies for a physical eKaminatlon, and 
Instructional aids for problem solving and decision making* ■ 

Xntorviewin[u HisLory Tnkjljn^ and Pat l ent Interaction 

A number of medical schools have developed instructional programs - 
using simulated or actual patients to train medical students in more ef- 
foetlvn doctor'-paticnt relationships (2,3). The participant interviewees 
have included mothers of essentially healthy children (4)| college students 
either rola plnying or describing aspects of their o\m lives (5,6), and persons 
with signif leant medical problems (7). Trained counselors (8) who can 
l^uida medienl stiulentn in Improving their teehniquen for the gynecologic 
exainlnnrlon Irnvu nlno been used, thereby combining aspects of patient in- 
teraction training wrth Instruction in physical dtngnosiB. 

Voluntary nnt] pnJd partieipantH liave been utilised. It apponrs that 
the majnr tncentlve for bnth groups hiiB been to contribute to the training 




of new physicians and to direct the medical students' attention to the 
patient as a person. The pool of pocentlal partialpants is large aad 
available in most communities* Generally high levels of satisfaction of 
both Instructors and students have been reported regardless of the grtsup 
of interviewees used. 

Commonly a students-patient encounter is videotaped for subsequent 
review and evaluation by the student and his tutor (9)^ Tlie objectives 
of the exercise con vary. The program may focus qhiefly upon the quality - ; ; 
of the relationship with the patient, on cognitive issues related to mastery 
of Mstory taking^ or on perfecting specific skills associated with the 
physical examination* Of course, several objectives may be combined (10). 

Fhysical Examination ' ' 

Instruction in physical examination has long relied upon patients 
for teaching purposes. Recently ^ however, new devices have become commer- 
cially available tlint students can practice certain components of the physical 
eKaminntlon on nQnliuman niodels* These include heart and breath sound simu- 
lators; several simulators for the ophthalmoscopic and otoscopic eKaminatlon;' 
breast, pelvic, and rectal examination models^ intubatioa simulators^ and 
at least three types of resuBcitatlDn mannequins. Other devices are In 
develapment and evaluation stageo (11^12,13)^ 

These devices can lielp students initially develop and then practice 
examination skills so that less time is taken in learning fundamentals 
witii iictual pnttants (14^15), Practice can be arranged prior to or con- 
current with Itt^If) experience, but need not be in tlie mO facility,. The 
costs oP purchaHlng^ opeirntlng, and maintaining the equipment can be as- 
sij^neil to the mud leal snhool^ not tlie WIO. Siich laboratories are currently 
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esf/iblit;|i£.<l nt MInhi(;,'in .Stntt- Univnr.slcy nnd the Unl.vornlty of Illinois ' 
(13). 

Clinicnl Prbhlem SolvinR 

^ Thu nppllc/itJuns of Simula Clon to teiich and evaluate clinical problem 
solving and decision mking cnn be Rrouped Into throe broad eatcgoriesi 
protocols and alp,orltlinia, low fidQllty simulations, and complex simulation 
Romes. Kacli has reliicivcly specif ic . purposes. 

il^lt££iaj^mtjUj3nxiy2£E- Wowchnrtts, nlRorithms, and decision trees 
arc a]] efroctlvD wnys to Icnrn the racommended way to work up and evaluate 
mnny specific ci inlcal problems (15,17,18,19). Broader use of these instruc- 
tional nids should be encournf.ed. One source of roslstance to their adoption 
seems to be that modicnl educntors huvo historically emphasJzed the implicit 
character of rules for working up patients and making decisions. Certainly 
the aim of medicnl education is not simply to tench a set of techniques, 
but also to tench understanding of the principles and rationale underlying 

.tHem. Ilowovfir, the logic of clinical decision making can be made explicit • 

and is more unslly lenrnod when It is.- Rnckground materials for protocols 
can ilUimlnnto the ratimiale for the steps in a workup and guide the students 
in an orderly and orffclent decision process. Miilo theBe learning aids 
can be uneful to niudJcal studants on an nnpntiont clerkHhip oxperiencc, 
thuir value as an aid to afficiunt pntlent workups is nios't likely to be 
iippruc latt'd In a coHt-c-onKc tous mo. 

Uiwjj jle 1 1 1 X J j Injn ons . The flov/ehnfts and decision trees just 
dlHcuiisud present a mod Jen] problem at a particular level of abstraction 
of ronlity, Thuy nnnuniD the student cnn ImnalnG n pntlent: and ptov%dQ 
gindalJncH ror Lhu ordnrly collactian and ovnlunt.lon oF dntn from that 
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patient. Tt; is nlRo pOBsiblo to presGnt patiant probloms in a format that 
more closely Hlmulntaa tlio rcnlity of patient Intcraccion ovor time. 

ComputGr-based Blniulatlons includo those prepfired by groups at the 
University of 111 fnois (20), Mnssachusetts Genoral Hospital (21), and the 
UnivcrslLy of Wisconsin (22)* A rangd of computer-simulnted cases are " 
now avniTabie t:hroup,b the llGalth Education Network, The topic has been " V 

recently revlawod thoroughly (23), 

Rimulatlons In paper and pencil format are also available for use 
as botli Instruc tional and evaluative instruments (24,25^26,27), Performance 
cnn be objectively scored and relatively prompt response^contingent feedback \ 
to groups of students is provided. As instructional devices j however, ' 
they need to he supplemented, since many relevant clinica] cues are nonverbal, 
Rimu]ationH with film clips * slides ^ and otKer nonverbal presentations 
of clinical data can be quite portable (28), but the process of design 
and revisnon is more time consuming, than for verbally mediated simulations. 
Thus the level of fidelity to be sought in a particular design situation 
depends upcm tlie intended audience, the purpose of the simulation, the 
expected frequency of revision ^ and the funds available, - 

TIic fich^lJty of paper-nnd-pencil simulations to clinical reality 
can be varicHl by nlterinn the amount of graplnc and pictorial material pruvidedp 
and by Lhc decision to use either a linear or brnnching format. In the 
IJnenr format, the student moves from one section of tlie case to the next 
in n fined sequence. At the bef'inning of oach new sect ion ^ optiinnl reso-- _ 
lutlon of the* preceding suct:Ion is often summarised (25,26)» In the branch- 
ing format, the student is perlodJcally offered a choice from among several 




al Lcrnntl v^t!H. Thu aov\t:c*nt of suhBQqijent sncfclons and thn number of sGctlons 
travcrsc^d hoforn the proiacm is concluded are n function of prior choices 
(24,27), ' 

The URO of aimulnt jnnf^ need not Im limited to Helf-instruction and 
evaluation, Thoy can also bo more closely integrated into classroom or 
clinical tCiachdng, by serving as the focus for group discussion or tutor= 
lals (29,30)* 

9Z^l]jlH^JJBl}£}li^ Snma slmulntlons combine an interactive 

problnm-'HOlvIng inRtructionnl format with a still higher level of fidelity" " 
to cllnicnl renliLy, A preceptor plays a diagnostic and management "game*' 
wdth one or mnre students and subaequcntly debriefs their performance. The 
patient's report of complaints in the medical history is provided by the - . 
Instructor in tlio patient'H o\m languane ho tliat the student can practice 
translating these verbal deBcrlptions into formal medical cues. Physical 
eKamlnatinn data and Inboratory tests are provided in the form of filmSp 
pictures, %-rnyf\^ laboratory slips, and audio tapes where appropriate. 
By extending tlie time frame cncompaSBed ]?y the Simula tion/ it is possiM^^ 
to provide either the patient's response to various treatments or compli- 
cationj^ nrisln^; when apprnpriate action* is delayed or not undertaken. 
Simulatuin ^nmoB witli these capabilities have been designed by Maatsch, 
noli^man, and Clreunbanm (31,32). Thn initial cases simulated involve prl- 
mnrlly medical and obstatr Lcal^^ynecolngical emergencies at nndergraduate 
Jeyeln of nompieKity, The cases selected are not frequently encountered 
during clerkslrlpB ancl reRidencies, 

The HimulntUHi game format lias been a usefiil adjunct in helping modi- 
en] studanLH Iji'ochlon their exparienre and shnrpun tliolr dingnostic and 



See 

mancincmGii t akinfi In Ulia abRCncG of rcml pnticnt cKporJoneiG* Tlie tochnlque 
Is msLly lulapLccl to tlio needs of n particulnr 1540 by Jointly asscissing 
the instruc tlajinl ncodH of the students and the caseload of the 1B40. The 
moHt prevalent cn«cs nnd the functions the student is to perform in the 
IMO setting; can be establislied so that the latter can be practicad under 
Simula Led game conditions until a desired level of proficiency is reached. 
If an existing game fits, it may be employed with relatlvcaly lictle traln--_ 
ing of UutorSj or new game can be designed rather easily by modifying exist^ 
Ing ll>t0 case files of appropriate patients. 

All inula t ion tecfmiques have the common property of representing 
certaJn features of the clinical process without direct Involvement of the 
patients or personnel of an actual clinical setting* The learner is then 
hetcer prepared and more able to function effectively during subsequent 
real patdant encounters in ambulatory settings. Slmulationi serve as pre^ 
para t Ion for clinical GKperience, not as substitutes for it* The optimal 
comblnntion of tliene techniqueH and the medical content to be s.tressed^ 
however, flepend upon Lhe goals nnd specific ohjectlves of a particular IIMO 
clerkHhip, With fund a men tn Is mastered in simulated clinical experiences ^ 
actual patJcnt contacts in tlic I IMO sliould be more rewarding for both the 
student and the organi tlon » 
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1 

An earllGr vGrslon of this paper was presantsd at a Conference 
on Tcnclilnft Primnry Care in the ITMOj held at the University of Roehester 
Medici] School, Mnrch 13=14, 1975, under the sponsorahlp of the AA>tC^ 
Preparation of this text was supported in part by grants from the 
Robert Wood Johnson Foundation and the Commonwealth Fund through 
the Center for the AnalysiB of Health Practices, Harvard School of 
Public Health, while thn senior author was on sabbatical leave. 
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Report of Efforts to Develop a Standardized Test of 
Knowledge and Attitudes Relevant to the HMO Setting 

Introduction 

Jerome Bruner 1n The Process of Education has pointed out that 
"exanil nations can also be allies In the battle to Improve curricula and 
teaching." in undertaking to develop curricula for physician training 
in HMO's, the AAMC proposed an evaluation of the results of efforts of 
the six participating medical schools. While each Individual school was 
free to undertake an evaluation designed to serve Its local purpose, the 
development of an evaluation tool derived from a common core of educational 
objectives was also considered as a cooperative effort. Such a tool 
should ultimately serve, as Bruner suggests, as an ally in the broader 
efforts to improve teaching of an HMO curriculum, not only for the 
institutions participating in the project, but in medical schools 
generally. This report describes the preliminary efforts to produce a 
common core Instrument, the HMO Education for Physicians Knowledge and 
Attitude Test (HEPKAT). 

While the report describes In some detail the effort undertaken to 
date, it 1s not final either with regard to the Instrument itself or 

the developmental work required to achieve minimum essential standards 

(2) 

basic to sound test construction. A more complete report is antici- 
pated by the end of this year. 

# 

Purpose of the HEPKAT 

The HEPKAT Is under development to serve primarily as an achievement 
test. While it includes a section measuring attitudes, the essential 
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purpose for the entire instrument is that of an assessment device 

designed to measure changes in students* knowledge and attitudes as 

a function of exposure to curricular experiences organized to meet a 

specific set of educational objectives. These objectives, which have 

(3) 

been described elsewhere^ represent a defined area of interest sig- 
nificant to the development of manpower in health care delivery settings. 
As such, the test 1s being so designed as to be useful for long term 
evaluation efforts, (e.g., to assess first year to fourth year change in 
medical students) as well as the short term evaluation of the effective- 
ness of a single course, a clerkships or an intersession experience in 
achieving the stated objectives. 

Description of the HEPKAT 

The HMO Education for Physicians Knowledge and Attitude Test 
(HEPKAT) is a four part instrument. The sections of the instrument 
include: 

I Knowledge Items; True-False 
II Knowledge-Judgment items; Multiple-Choice 
III Attitude items; Likert Scale 
IV Career Choice Information 
Minimum biographical identification information can be obtained 
on the cover sheet. The three sections testing knowledge and attitudes 
contained 30, 20 , and 77 items respectively in the first administration 
of the test. The number of Items will not remain constant in subsequent 
administrations of the testp since test statistics will be obtained 
and used to improve the Instrument, Nevertheless, In Its present forms 
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It requires approximately 40 minutes for administration. Since a 

practical goal was set to produce an instrument that could be 

administered within the limits of a 50 minute class periods the test 

will be lengthened somewhat in subsequent drafts* Keeping the test 

sections at maximum length compatible with testing opportunities 

defined by the purposes set forth above Is an objective that derives 

(4) 

from the known relationship between test length and reliability. 

The response format for each section of the test Is standardized 

to assure easy familiarity by any group of respondents and also to 

expedite the development of test statistics to be used in test development. 
In its present form the test is a mimeographed document available 

from the author without cost in exchange for data that can be used in 

its development. 

Method 

The initial Impetus for this effort derived from a Joint conference 
of the six schools held at Cambridge on September 29-3O5 1975. At this 
conference, interest was expressed in the preparation of cormon evalua- 
tion devices to avoid duplication of effort* to allow Inter-school com- 
parisons ^ to evaluate the project in its entirety and as a useful by- 
product for future research purposes- A later meeting of the project 
evaluators was held at the instigation of Marcel Infelds AAMC project 
officer, on November 9, 1975. The participants in this meeting reached 
the consensus that an Instrument reflecting a core of curricular 
objectives common to all schools could and should be developed. The 
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steps Involved Item writing, editing of Items and rational evaluation 
of the content validity, preparation of the test format and a prelimi- 
nary draft copy, and finally collection of data from readily available 
samples of students. To date these steps have been completedj although 
only a small sample of students has been tested. Results for this 
sample are presented here in order to give some preliminary statement 
of the range and type of responses to the proposed Items and to entourage 
further use of the HEPKAT so that development of the Instrument can 
proceed. 

In addition to the completed steps outlined above, further plans 
call for the addition of Items according to a map of the curriculum 
content domain outlined 1n the University of Pennsylvania set of educa- 
tional objectives* Table 1 presents the initial plan for item writing 
distinguishing between two categories of items: (1) those designed 
primarily to assess learning of cognitive materials at the knowledge 
levels and (2) those designed to assess affective learning as reflected 
In attitudes. For the first category, the assessment of knowledge, two 
item: types were used , true-false and multiple-choice. The measurement 

of attitudes was approached using Likert type attitude items as a basis 

(4) 

for later scale development. While the format in Table 1 Indicates 
the Intent to spread items oyer the various content categories as a 
means of assuring content validity. In practice the preliminary draft 
of the HEPKAT falls short of this objective (see Appendix A). More 
true-false andLlkert type items were obtained than called for in the 
plan and fewer than the desired number of multiple-choice items were 



# 

Table 1. Item source and distribution plan for development of the HEPKAT 
content and format (Ni entries are estimates of final' number of 
items to be derived). 

Curriculum modules 



1 2 3 4 5 6 

Itm Primary Health Active OnT Economics Change 

Format Health Care Care Consumer Quality of and 

Comprehend Team Partlcl-^ Health HMO's Innovation 

sive Care pation Care 



True- 
False 
N1=60 

Knowledge^^ 

. Multiple 
Choice 
N1M8 



Semantic 
Differ- 
ential 
N1^8 

Atti tudes 

Llkert 

Items 

N1^54 



Taxonic 
Content 



available. These differences will be rectified as the test Is revised 
and Item data from larger samples become available. Thus* Items with 
extremely high or low difficulty levels or with poor item-total correla* 
tlon will be discarded before the test format As finally set. 

Items were obtained by several ireans. Source documents such as 
An HMO Dictionary and A Medical Student's Guide to Health Maintenance 
Organizations were carefully reviewed. As another step^ the provider 
staff of the Penn Urban Health Maintenance Program was extensively 
employed ands through the use of guided Interviews ^ encouraged to 
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generate both knowledge and attitude items. From this latter effort, 

we were more successful In obtaining attitude Items as opposed to 

cognitive items, the latter being most readily generated from the 
(5.6) 

source documents. 

The essential activity involved in the construction of a measurement 
instrument is that of mapping stimuli, usuany test items, into a number 
system. A test score or a profile of scores represents the final 
product of an entire set of mapping operations. To assure that the 
numbers assigned to students as test scores have meaning, we strive to 
achieve a number of characteristics for our test. One characteristic 
sought is often referred to as the functional unity of the test and 
implies that some degree of consistency exists in the way we mapped out 
the test and then subsequently assigned scores or scale values to the 
particular stimuli or test items. The operations of test construction 
affect the functional unity and are implicit in decisions made in the 
development of the HEPKAT, such as selection of item format, number of 
Items, range of scale values, and practical considerations in the use 
of the test for assessment as opposed to prediction. These considerations 
are particularly of concern in the development of attitude scales. In 
addition, two other characteristics of a measurement instrument, 
reliability and validity, required attention. The mapping described in 
Table 1 above is Important to the content validity of the test, while 
decisions on the number of items will later affect the reliability of 
the test scores, which in turn can affect its utility in assessing the 
adequacy of a new curriculum change. 
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The objective test Items cast in the true-false and multiple-choice 
format in Parts I and 11 of the test were designed to test cognitive 
material in the curriculum. While the majority of the items would 
generally be classified at a low level in the taxonomy of educational 
objectives, calling as they do for factual knowledge or Information, 
some require higher order processes. As the test Is further developed 
every effort will be made to include additional items that require the 
higher cognitive processes. 

In the construction of attitude items in Part III, the fundamental 
requirement is the opportunity for the respondent to express some degree 
of orientation either for or against the object, person, relationship, 
or activity being described. The Likert method was employed In this part 
of the test. It Involves an initial compilation of a set of statements 
related to an attitude object which are then presented to a group of 
respondents to^be rated according to the extent of their agreement or 
disagreement. Once we have obtained data from a group of students, 
some items will be eliminated, others rewritten or improved, and on the 
basis of the interrelationships among the items, an attitude scale of 
some consistency will be cast. 

The first opportunity for use of the HEPKAT preliminary draft 
was with a group of 27 students who attended the Intersession Course 
on Comprehensive Care at the University of Pennsylvania. This week 
long course is staffed by primary care providers In the Penn Urban 
Health Maintenance Organization and Is an intensive experience involving 
approximately 35 contact hours with the students. In the group tested 
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with the HEP^Ts there were seven students from medi dnej six from 
nursing, five from social work, and nine from anied healthy law 
administration and other fields with a related Interest, The inter- 
session experience was a short. Intensive introduction to most aspects 
of the HMO curricular content developed In the AAMC project, A pre- 
test was administered folloWing introductory coirments the first morning 
and a posttest was employed at the end of the fifth and last day. Some 
personal rating scales were dropped from the posttest administration 
due to time constraints; otherwise the test was identical for both 
administrations. 

One development anticipated for the future will be the generation 
of alternate forms of the test designed to be comparable in content, 
difficulty level, etc. 

Results of the Pilot Sample 

The first three sections of the test* were Initially analyzed 
separately. The analyses focused primarily on item data and rapid 
approximate non-parametric techniques were employed. 

Part I of the test, the true-false section, yielded pretest scores 
on the 30 items ranging from 14 (a score that could be obtained by 
chatv^e) to 27. For the posttest^ the range was essentially the same, 
i.e,, 16 to 27, although the average score increased,^ Part II ^ the 
multiple-choice section, had pretest scores ranging from 10 to 18 and 
posttest scores ranging from 11 to 18. The rank order correlation of 
pretest scores on Parts I and II was .41. When Parts I and II were 

. h. - 
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combined to yield a total score for the knowledge sectioni scores 
ranged from 24 to 43 on the pretest and 28 to 45 on the posttest. The 
pretest mean for the combined Parts I and II was 33.3 and 36.5 for the 
posttests Indicating an increase of three items answered correctly for 
the group. While this 1s statistically significants it may be somawhat 
more meaningful to indicate' that of 24 students for whom the test data 
were complete from pretest to posttest p 20 Improved their score, one 
stayed the same, and three experienced a decrement in their scores. The 
raw scoretmeans :arid, rangesi.ara prisented in Table 2, 

Table 2. Pretest and posttest means and Paw score ranges for 24 
Intersesslon students on objective test Items, 



Raw Scores 







Mean 


Range 


rhoj J J 


Par^ I 


Pretest 
Posttest 


21.2 
23.1 


14-27 
16-27 


.41 


Part II 


Pretest 
Posttest 


12.5 
13.4 


10- 18 

11- 18 ; 




Total 
Score 


Pretest 
Posttest 


33.7 
36.5 


24-43 
28-45 





Item difficulty levels were also examined, as were the Item total 
correlations, but the sample size Is not sufficient for these analyses to 
yield data of any psychometric interest pertinent to test development. 
It Is of casual Interest that the Items did range in difficulty level 
from four Items which no one answered incorrectly to ten Items of 
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sufficiently high difficulty level that the group did „o bette. than a 
Chance response on the pretest (Table 3). ,n brief, the objective test 
ne.s covering the Knowledge component of the test are promising and. 
If the Pilot sample Is at all indicative, should, with further develop- 
ment, yield a reliable, valid and discriminating instrument. 

Finally. Part in was analyzed by comparing pretest and posttest 
responses item by item for the total group. Complete data for this 
analysis was available for 23 students. Pretest and posttest item 
means are presented in Table 4. These give some prospective Indication 
Of the direction of scoring for the items but further development of 
Part in awaits a sample size sufficiently adequate to subject the items 
to a factor analysis as a preliminary step in scale development. A 
minimum sample sUe for such an analysis would require at least three 

times as many subjects as we have items Thus =. ■ 

iiyv^ iLeriib, musj at a mimmum m will 

need approximately 250 students. 

Again, for illustrative purposes, we have presented, iir Table 5 
those items which yielded significant chl-squares when pretest and 
posttest responses were compared. Item responses were dichotomized as 
close to a median split as possible and a chi-square computed from the 
resulting four-fold table for each item. Eight items had response 
changes from pretest to posttest at less than the .10 level of confidence. 
Since 77 Items were analyzed, one might expect eight such results by 
Chance alone, not an auspicious finding. Examination of the content of 
the eight items is interesting, though, inasmuch as there is a communality 
represented in these items which is. antithetical to the concept of rando™ 
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Table 3. Parcant Corract Response for Objective 
Test Items for Pretest Group (N=27) 



Trua-False Items 

Percent Percent Percent 

Item No. Correct Item No. Correct Item No. Correct 

1 96 11 59 21 .89 

2 41 12 48 22 82 

3 100 13 74 23 48 

4 37 14 93 24 70 

5 100 15 96 25 100 
S 85 16 67 26 100 

7 89 17 85 27 85 

8 63 18 93 28 59 

9 82 19 44 29 44 
10 85 20 33 30 26 

Multiple-Choi ee Items 

1 89 8 56 15 89 

2 85 9 22 16 30 

3 63 10 63 17 93 

4 41 11 56 18 67 

5 63 12 63 19 78 

6 93 13 78 20 48 

7 89 14 89 
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Table 4. Item means for HaPKAT attitude statements for 
pretest and post test. (N -- 23) 





Pretest 








Postest 


Item 


iretost 


rostest 


Item 


Pretest Postei 


No. 


Mean 


Mean 


No, 


Mean 


Mean 


No 


Mean 


Mean 


No 


Mean 


Mean 


I 


4,83 


4.65 


21 


2.30 


1.78 


41 


1.26 


1.43 


61 


4.22 


4.26 


2 


3.78 


3.48 


22 


2,17 


1.87 


42 


i.78 


1,96 


62 


2.61 


2.39 


3 


1.70 


1.57 


23 


2.04 


1.87 


43 


1.61 


1.65 


63 


4.04 


4.30 


k 


4.09 


4.00 


24 


4.56 


4.35 


44 


4.09 


4,09 


64 


2.70 


2,61 


5 


1.30 


1.26 


25 


1.74 


1.61 


45 


3.83 


3.91 


65 


3.91 


3.87 


6 


2.83 


3.26 


26 


2.22 


2.48 


46 


2.96 


3.04 


66 


4.00 


4.26 


7 


3.57 


3.91 


27 


3.91 


3.83 


47 


3.87 


3.78 


67 


2.96 


2.91 


8 


2.26 


2.57 


28 


1.87 


1.96 


kQ 


2.43 


2.35 


68 


2.35 


2.65 


9 


2.78 


3.43 


29 


2.83 


2.48 


49 


1.87 


1.65 


69 


2.30 


2.26 


10 


3.57 


4.04 


30 


3.57 


3.17 


50 


2.04 


1.91 


70 


2.96 


2.91 


11 


2,70 


3.22 


31 


2.96 


2.57 


51 


2.57 


2.17 


71 


1.83 


1.87 


12 


2,61 


2.48 


32 


3.26 


3.00 


52 


3.22 


2.65 


72 


3.74 


4,00 


13 


2,87 


2.70 


33 


3.04 


2.74 


53 


3.26 


3.74 


73 


1.61 


• 1.35 


14 


2.26 


2.09 


34 


2.61 


2.30 


54 


4.04 


4.43 


7^ 


2.39 


1.83 


15 


4.13 


3.65 


35 


3.87 


4.00 


55 


1.96 


2.13 


75 


2.00 


1.61 


16 


4.39 


4.48 


36 


4.26 


4,30 


56 


1 .87 


1.83 


76 


3.39 


3.61 


17 


2.52 


2.13 


37 


1,52 


1,52 


57 


3.78 


4.00 


77 


1.96 


1,78 


18 


3.52 


3.^3 


38 


2.00 


1.91 


58 


2.09 


2.22 








19 


1.91 


2.04 


39 


1.78 


1.91 


59 


1.91 


1.7^ 








20 


3.57 


3.52 


40 


1.61 


1.70 


60 


1.48 


1.39 
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Tables. HiPKAT attltud© statements yieldinf sipililoant 
ohaiigas from pretest to posteat In order of 
rai^ltude ot the ahlstuar© obtained. (N ■ 23) 



Attitude Statement Pretest^ Poatest^j P Dlreation 

Item Me«i Item Meitfi of Qhange 

The prilniary he^th om© pTOvlder shoiad 2,00 l,6l 9,68 <.01 A-*SA 
asuume responsibility for Integrating 
the patient's health care, 

Many physician assistaita do not have a 3*22 2,65 9.13 <t01 D^u 
college education 

The major fimctlon of nurse practitioners 3,26 3.74 7,56 <,01 u-^D 
is to do hlstorlee and physicals with 
diagnosis and treatment being left up to 
the physician. 

In a health care tem, the design for 4,13 3*65 5,85 <,05 D-»u 
dia^osls and treatment is the sole res- 
ponsibility of the physloian. 

The function of nurse practitioner is to 4,04 4,43 4.57 <^05 D-*SD 

take phyolclan's orders ^ 

In a health care team, the nurse practl- 2,5? 2,17 3*70 <.10 u-^A 
tloner monltorE the patient's progress 
over time and modifies treatment aooor- 
dlngly. 

It is Importwit that therphyelclan fUrect- 2,78 3.43 3,14 <,10 u^D 
ly obtain the Infonaatlon essential to a 
complete history and j^yslciJ. 

To do good primary ewe you have to know 3,57 4,04 2,99 <.10 u^D 
everything 



1 m Strongly agree 1 2 ^ Agree i 3 ^ Uncertain | 4 ^ Disagree | 

5 Strongly Dlsa^ee 



u 00 



findings. Most of the items are in some way concerned with the 
relationship between the nurse practitioner and the physician 
vis-a-vis their role responsibilities. 

In general, the results of this small pilot sample are most 
promising and a number of first order objectives were served. We did 
not show dramatic changes from the Monday to Friday pretest-^posttest 
administrations of the test, but both test and curriculum are in the 
first stage of development and the eKposure time for the students was 
very limited. In retrospects those areas for which the students 
showed a good deal of interest and motivationi such as the team 
concept or the physidan-nurse practitioner relationship were areas in 
which the test showed some sensitivity. 

As important as the statistical data* was the opportunity to 
observe student response to the type of Items being tried, to observe 
their behavior In the test situation^ to estimate the time required to 
take the test* to find editorial corrections 1n the instructions, and 
to develop some confidence that the general format and content of the 
items appear to be serving our purposes. In the next use of the test, 
several items will be dropped, such as those which were of such ease 
that no one marked the item incorrectly. We can learn from even this 
small bit of data that many of the multiple-choice incorrect answers 
do not serve adequately as seductive dis tractors and may therefore need 
to be rewritten in order to raise the difficulty level of the item. 
These and other corrections and improvements will be incorporated into 
the next draft of the HEPKAT. 
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Sunmary and Projected Plans ^ 

Pralinilnary efforts to develop an Instrumant to test knowladga and 
attitudes relevant to core content In curricula, for physician training 
in HMO's indicate the feasibility of such a plani Results of a small 
pilot sample exposed to the curriculum content for a one week intensive 
experience indicate that the items produce a range of response and: 
are sensitive to change over even short exposure to the curriculum* The 
need for revision of items is apparent and next steps in the development 
of the test include adding items in certain content areas t testing a 
larger sample and subjecting the attitude items to a factor analysis for 
the purpose of developing reliable and coherent subscales. 

Follow-up plans are outlined in the Timetable presented in 
Appendix C. This tentative outline is contingent upon the continuing 
interest of the cooperating schools and others who may wish to 
participate in this developmental effort. Most critical to continuing 
progress on the test will be access to students for testing time. In 
the next effort opportunistic samples will serve our purpose. In the 
final stages of test developTOnti thought representative samples of 
medical students will be required in order to establish norms to 
enhance the general value of the instrument. 
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HMO EDUCATION FOR PHYSICIAN KNOWLEDSE AND ATTITUDE TEST 



Xdentifiaation items 
Name 



Field of study _ 
Year In prograni 



Preliminary Draft 
Edwin B. Hutchlns, Ph. 
January » 1976 




n58 



PART i. Each of the statements below are generally true or generally false. 

Please Indicate your response to each statement by circling one of the 
two following alternatives s T=«truep F"falae 

I- TP The goals of health inaintenance are prevention of disease and dlaabllity 
and early identification of abnoinnalltles or threats. .to health. 

2, T F Blue Cross and Blue Shield is a f ee-for--service plan. 

3. T F The social worker has specific knowledge about comunity resources. 
4# T F The first medical cooperative in the United States was organiEed in 

the late 19th century, 

5. T F Environmental factors strongly influence the health of an individual. 

6. T F Economic factors strongly influence the health of an individual. 

7. T F Psychosocial factors strongly influence the health of an individual. 

8. T F A carrier does not underwrite risks in health care Insurance. ' / 

9. T F For the most part, at the preeent time the ^erlcm medical system is 

directly accountable to patients, 

10. T F Community corporations are being developed mostly by large insurance 

companies • 

11. T F In November of 1975^ major employers in the IMited States were required to 

offer a dual option to their employees. 
12* T F A "hesitation payment" is a charge required of a patient who ^sses an 
office visit appointment, 

13. TEA volmitarily enrolled group is one in which the employer can exercise 

his option to enroll his employee, 

14. T F Periodic followups are not an essential component of comprehensive care, 

15. T F For the patient, finding a place where appropriate health care is delivered 

at a reasonable price is a major problem. 

16. TEA provider is an insurance carrier providing the maans to pay for health servli 

17. T F Twenty--four million Americans have no health insurance of any kind. 

18* T F An individual -s race can be a deciding factor in the quality of the health 
care that he receives , 

19. T E Capitation payment is the amount of money required per person to provide 

covered services for an unspecified period of time. 

20. T F Reciprocity implies the right of a group health plan member to receive 

medical care from any other HMO in his home area. 

21. T F Prepayment provides in advance for the cost of predetermined benefits for a 

population group through regular periodic payments. 

22. T F An option offered an employer between two provider organizations is referred 

to as dual choice. 

23. T P An cKt ended care facility provides prima^, secondary, and tertiary levels 

of medical care. 

24* T F Cost centers are functional areas that generate the basic costs incurred to 

provide the planus range of benefits. 
25. T P Comprehensive care provides for that broad spectrum of health services 

necessary to the prevention * diagnosis and treatment of physical and 

mental Illness and to the maintenance of health, 
26* T F Blue Shield is a propaid health plan designed specifically to cover the needs 

of municipal employees such as policemen and firemen. 

27. T F In some HMO's, eKpansion is computed as part of the capitation rate to 

provide capital for growth, 

28. T F A fee schedule is the schedulu of payments a fee-for=-aervice patient 

makes when subjected to catastrophic illness. ^ 
29* T P The term health maintenance organization Is specifically defined by law. 
30* T F A noncontributory arrangement is one in which the employeri union, or I 

third party pays nothing. ' 
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II ' For the following items , saleet a single best answer. Please Indieate your 
p.'/-":'' response by circling the letter in front of the alternative you have chosen 

as the correct answer. 

»• nilrd party pay^nts 

A* are payTOnts for health care aiade by the ^ beneficial in his own behalf 
B« are payments for health care when the beneficiary is not s^klng payment 

In whole or in part on his own behalf 
C* are payments made by a parent or guardim in behalf of a dependent 
D* are pays^nts made a third party ta behalf ^o€ the consimer* 

• Placement in an eKtended care facility should not be based upon 

A# medical problem 

B, ability to pay 

Cm social problema 

D« functional impairment 

. In 1848 the first British public health leglBlation was primarily concerned with 
A* mandatory vaccination 
B. sanitation 

The Royal College of Physicians 
D« medical education 

In the period from 1960 to 1970, hospitalization costs In the United States Increased 

A# eqiiivalent to the stmdard of living Index 

B, 25% 
I C. 100% 

^ 300% 

• Under a unlon^sponsored health benefits program, fimds to finance the program may 
come from all but one of the following 

A, federal government matching fimds 

B, union meiribers contributions alone 

C, employer and union members contributions 

D, employer contributions alone 

s Is the provision of health cares accotmtablllty should be to 
Am one^s professional colleagues alone 
Bm to the patient alone 

C- to the patient and the profession i 
D» to the patient^ the profession, the comunlty and society at large 

I Which of the following practice arrangements do not generally have salaried 
physicians?:.. 

A* Kaiser Permamente 

B« fee^for-servlce practice 

Cm fotmdatlons for medical care 

D. the Public Health Service 

Bie Health Maintenance Organisation Act P*L* 93-222 did all but which of the following? 
A* provided prospective eligibility to both PPGP plans and MCF plans 
I B. made optional the dual choice clause 

' C* added support to existing plans through grants and loans 

D. encouraged the development of new HMO's 

9^- 060 
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?i 0^^^ some HMO's ara not "qualified'! Is that 

comprised, of ', multi-specialty ' • ■ V-^^' ■:;.>?>ii 

|pV;^:Y^ -^'thay, did not 'apply/for federal -funding ^--v ." '. • ■ ' - ■ = r '--^i^^^ 

==■'/'■ :.C.- .they hava a reeopilged medical /group ^ ' 

: a ^* they have become a recognized Individual Practice Association 



lO. The concept of comprehensive care focuses on 

A, the development of extended care facilities for the elderly 

the maintenance of phyaical and mental health as opposed to illness 
G, Patient education so that the care provided Is compreh^ 
therefore folldwed by the patient 

a broad epeetrum of health services toaluding^p^^ 
hospitalization 



11. Of the following quality control groupa, which one also performs third party ftttibkiiS 

A. eertif led hospital admission program - 
B* professional standards review organisation 
Ct quality assurance program 
D# medical care foundations 

12. Which of the following is not a health status Indicator? 

A* activities of daily llvlpg 

B. morbidity . . 
C# race 

D* fimctional assessment . 

13a Medicare Is a praram designed to 

[ A. pay most of the health care eKpenses of the Indigent 

B. pay most of the health care eKpenses of the elderly 

C, axperiment with national health Insuraice 
...D, redistribute the wealth 



14* Accessibility implies that health care Is 
A* paid for by a third party 
B* close to one's home 
/ C» within the reach of all 

D, geographically, financially, and socially available on an equitable basis 

15, Which of the following is not a basic principle for developing an effective HMO? 

A* prepayment . 

®4 a dependent, externally governed physician's organization 

Cv a contractual responsibility between the plan and its m^ers 

^' physician payment Influenced by shared financial responsibility 

16. H^'s are careful to allow the mentoers free choice by 

A* avoiding mutual contractual commitments 

B» suggesting alternative providers whenever they Indicate dissatisfaction 

C. leaving Issues of accountability entirely to the Miners- consumer 

organization 

D, allowing the members to choose from among the HMO's accepted physlclana 
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|ij •Evaluation of HMO perforMUGe has been dona throu^ uCllliatlon studies » These 
pl^flndings show ; 

= • A* lewer hospital utillzatldn. and elective su^gery^ rates ^ 
^^vi V hl^er fMlly health cars e^endltures 
j^^^ C. no ehange In inf mt TOrtallty rates 

jf;^; D. no chmge In mortality rates for the elderly 

7 By 1980 the need for physlelans practicing in iQiD*s Is estl^ted to be 
- A* 10,000 

V B. 20p000 

V C, 40>000 . 
D. SOpOOO 

The traditional dlatinction between the prisary role of medicine Md the primary 
; role of nursing lias In 

A* application of the "curing" and "caring" processes 
B« the level of con^etency achieved 

Cm the quality and comprehenaiveness of the respective educational programs 
D* acceptance by the patient 

Whl^ of the following is not true of home care programs? 
A, they are easily organised 

B# it la one of the least utilised eervicas a hospital offers 

C# it is an ii^ortant and recopilsed alternative to inpatient care 

D» it la one of the more eKpenslve medical services 



i ^AM--n i, Indicate your reaetlon to each of the following stataments |by cirellng one 

i?^r ' r of the five following alternatives I ' SA Strongly Agree 

mi&y-'-/ ^ / . - A Agree - 

Wiy^^'- ■■' ■ U Unaertain ' 

:fv' ■^■■'■^ ■ ■ ^ . ■■ D Disagree ■ ' 

3' SG Strongly Dlsagres 

Please do not omit my items, , f'p 

Recognising the impact of chronic disease on patients mid ::jP| 

family is not a concern of the primary: physician, , 0^ 
In medicine t competency is directly related to the amoimi. of schoolin|^#|^ 
Physician aisistant and nurse practitioners* because of differing 

educational and professional experiences ^ bring added dimensions --/^^ 
to the health care setting. it^^ 
Nurse practitioners who seek to serve some of the physician -s ;n;Vv5JS^ 
functions are practicing medicine without a license, ^■^r^]^-0M 
Regardless of station in life, all citXiens^have^a^rlgh 

health. care. vrf-Ji^li 
Social services are primarily made available for lower socio-- i^-' : 

economic class patients, ' ^ll 

In a health care team the primary concern of the social worker is ^v|| 

the patient's difficulties with flnaricee and hoxieing, ' ■ 

Because providers generally come from middle class backgroimdsi^ 

they have problems relating to lower class patiants, 
It is important that the physician directly obtain the information 

essential to a complete history and physical. 
To do good primary care you have to know everything* - 
Physician assistants and nurse practitioners are primarily well 

trained in physical diagnosis. 
It is reasonable for a nurse practitioner to have a signed pad of 

prescriptions for prescribing specific drugs under protocol, ^ 
Because the government only reit^uraes at given levels of payment, 
publicly supported patients will necessarily receive health care 
of a lesser quality than that received by private patients. 
An Important function of the social worker is to stimulate ^ 

positive change in health care delivery* 
In a health care team, the design for diagnosis and treatment is 

the sole responsibility of the physician* 
The primary care physician need not maintain communication with 
the patient during the period when a consultant is involved 
in a specific course of action* 
Any inadequacies in health care in this country are especially 

felt by those who are not white or male. ......... 

A nurse practitioner is a nurse with a few added skills, 
American doctors are generally chauvinistic. 

The phyeiclan who utilizes the services of nurse practitioners 

is constantly risking malpractice suits. 
Middle and upper socio-economic families have psychosoclaj,' needs which 
must be met in any truly comprehensive health care delivery system. 
In working with families ^ihere the incidence of psychosocial problems 

is high, the social ; sr could be the primary care provider. 
Because of her nursing b^/Kground, the nurse practitioner brings to 
the health care team skills and attitudes dlf farent f rom those 
of the physician- 
Information obtained from consultants is medical in nature and need 
not be shared with other metiers of the hea^lth care team. 
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SA A U D SD a ''bad cold" .. .. , ' 

MliSA A U D SD painful burning on urination 

S' sA^ D n^n following reB»val of a cancerous pancreas 

p. SA A 0 D SD mj- ISth.month old Infant who ha. a tamparature of 104 and Is 

^ pulling his ear 

W. SA A U D SD ^ 6 year^oia child who has started bed watting aftsr balng toilet 
C CMlned for 3 years 

1^. 3A A U D SD Physician assistants working in hoapitale should be able to write 

_ OTdmtB under protocols. 

|i.|^^|J|.„^Hrses_«.^^^ to mke patients feel coafortable. ' 

|. SA A U D SD Tha^psychiatrlst is the only provider competent to deal with mental 

7. SA A U D SD The patient should be a participant in the health care team's 
i CA A tT decisions regarding his health care. 

B. SA A U D SD in a health care team, the social woricer is concerned with the 

J. SA A U D SD Th/l«rfi"L" J""? ^^'f a«d his ability to cope with them, 
f . bA A u D SD The Individual physician has an obligation to help change the 

■y "^^Ith care delivery system In this country. 

^^^^'^^^^'^^'-'^ '^ -^^^ Physicians .and 

Ia A H n E:^ patient's family requests another opinion. 

^ Ia i U d is The physician feels that the. problem exceeds his competency. 
., SA A U D SD Patient care can be Instituted more efficiently or economlLlly 
\ , by another physician. 

^ SA A U D SD The relationship between the physician and/or family is unsatisfacto^. 

;. Sa A^U D SD In a health care team, the principal task of the nurse practitioner 
SA A u n qn m,4^^ ^tu""^""^ co^Plaint and measure the vital signs. 

. SA A U D SD While other consultants are involved in a patient's , care, the primary 

care physician Is temporarily removed from the ongoing management 
of the patient. , e © 

. SA A U D SD It is dangerous to give a person a few skills and then turn 

„ , the person loose with patients. 

. SA A U D SD HMO's are a form of conmunism. 

. SA A U D SD A physician should be able to trust the physician assistant to 

prescribe certain drugs under protocol. 

. SA A U D SD The social worker enhances the physician's understwdlng of the patient ' 

as a whole person with definite environmental factors Impingina 
on his health status. f s b 

SA A S D sS ^ ale«^^h' ^« '^at of patient advocate. 

&A A u D SD In a health care team, the nurse practitioner monitora the patient's 

BA A ,T « e„ progress over time and modifies treatment accordingly. 

1a t n n II physician assistants do not have a college education. 

&A A u D SD The major function of nurse practitioners is to do histories and 
physicals with diagnosis and treatment being left up to the 
I physician. 

FSA A U D SD The function of nurse pracitioner is to take physician's orders. 
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■ 55. SA A U D SD An important role of thi^ social worker Is to ^facilitate competencies ^^L 
liV; ; ®^ health care team members in the ossesstitent of psychosoclol 

factors in the health care of the patient, J^j 
|: 56* SA A U D SD The social worker aids the physician In appropriate use of psychosociar 
'iV providers through collaboration or direct referral* ' 

^I^ SA A U D SD In a health care team^ the principal task of the phyaleian is to 

obtain the history and perform the physical eKa^nat ion. 
; 58, SA A U D SD Specialisation is Important becauae you can't know every thing, 
|^ 59, SA A IJ D SD Many of the traditional functions of a physician can be adequately / 

served by a nurse practitioner, 
; 60. SA A U D SD Regardless of the method of payment * all patients in a comprehensive 

Y health care setting should receive the same quality of care, {-5 
• 61^ SA A U D SD The social worker -s primary function is to help the patient obtain , i 

welfare monies* 

62* SA A U D SD In a health care team dealing with a child performLng poorly in V 

schoolp it is the responsibility of the social worker to i 

V obtain records from the school* -\ 

63, SA A U D SD Primary care is not intellectually challenging, T' 

64, SA A U D SD Under protocol, physician assistants should be able to treat coimaon 
■- chronic diseases (such as hypertension, chronic heart disease, 

diabetes}^ including ordering and interpreting tests and making 
the decision for prescription of medication, 

65, SA A U D SD Different levels of health care are to be expected for people of 

different socioeconomic classes* 

66. SA A U D SD There is no need for a sqpial worker In servicing middle class 

obetetrlcs patients* 

67. SA A U D SD The princlpaT role of the nurse practitioner is to execute the ,^ 

simpler tasks traditionally assumed by physicians. 'M 

68. SA A U D SD In a normal family situation^ the social worker should be an ^ * 

Integral part of the primary health care team. 
69* SA A U D SD Physicians should be willing to sign prescription foiroa filled out 

by a nurse practitioner colleague, t' 
70* SA A U D SD nie level of competence of a nurse practitioner approaches that . ^ 

of a general physician. 

71, SA A U D SD In dealing with a f rally having limited resources, knowledge about 

available community fund agencies can be as important to health 

care as medical information, : 

72. SA A U D SD Nurse practitioners should not be allowed to deal with patients 

except under direct supervision by a physician, ^ \. ^. ...... .[..i,...^^^ „1 

73* SA A U D SD Patient education is an important function of an HMO. 

74. SA A U D SD Nurse practitioners are co*^equal with physicians as meters *of 

the health care team* 

75* SA A U D SD The primary health care provider should assume responaiblllty for - 

Integrating the patient's health care. 

76. SA A U D SD 1 would feel more secure working in a limited field than In 

general practice. 

77, SA A U D SD The health care team repreaents one of the most efficient means 

of del iveryy quality health care* 
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Career Choice Items 

This section of the test asks for information on your plans 
for the future. We would like to obtain here your best 
estimate of the kind of career you would like to have when 
you finish your training. 

Please estimate the percent of time you plan to spend In each of 
the following professional activities. 

Time In Percent 
Patient Care ____ 
Research 
Teaching 
Administration 
Othe r " 
please specify 100% 

Please indicate which field best describes the medical practice 
you plan to enter. Check one only. 



Anesthesiology 
Basic medical sciences 
Dermatology 
Family practice 
General practice 
Internal medicine, general 
Allergy 

Cardiovascular disease 
Endocrinology 
Gastroenterology 
Hematology 
Infectious diseases 
Pulmonary disease 
Neurology 

Obstetri cs/gynecol ogy 

Ophthalmology 

Otolaryngology 



Pathology/cHnical pathology. 
Pediatrics, general 

Pedi a t r 1 cs s all ergy 

Pediatrics, cardiology 
Physical medicine and rehabnitatlon 
Psychiatry 

Public health and preventive medicine 

Radiology 

Surgery, general 

Surgery, neurological 

Surgery^ orthopedic 

Surgery^ plastic 

Surgeryp thoracic 
Urology 

Others please specify: 



What type of practice do you plan to enter? Check one only. 
Solo 

" Partnership 

Group 

Hospital based 
HMO based 

\ Other; please specify: ^ 
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HEPKAT scoring key for preliminary draft Parts I and II 
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APPENDIX C 
Project to Refine the HEPKAT 
Time Table for Implementation 



m^m. ' Target Date 

1. Send copies of preliminary report on HEPKAT March 28, 1976 
to Project Evaluation Consultants 

2. Return critique of preliminary report and 
suggestions for Item revision and addition 

of new Items ^p^^, 23. 1976 

3. ' Revise draft of HEPKAT; delete and add Items May 1, 1976 

4. Readminlster to opportunistic samples April, May 1976 

5. Pooling of available data from six schools 
for test analysis: 

(aj Item anayses. Parts I and 11 June 30, 1976 

(b) Factor analysis, Part III julv 30 1976 

(c) Item correlations with Part IV 'Informa- 

tion on career choice July 30. 1976 

6. Construction of attitude-scales August 15, 1976 

7. Refined form of HEPKAT completed and printed September 1. 1976 

8. Testing of entering first year classes of 

cooperating schools September 30, 1976 

9. Scoring of test protocols and development of 

normative data for entering classes October 30, 1976 

10. Correlation of data with career choice Information November 15, 1976 

n. Feedback via return of Individual school profiles 

to cooperating schools December 1. 1976 

12. Final report Dg.g^ber 30, 1976 
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ABSTRACT 

Although the role of curricula 1n the determination of 
physician career choice is obscure, it is generally accepted 
that career options such as primary care will atract more sub- 
scribers if they are better represented In the curriculum. This 
project designed, applied and evaluated a semester long series 
of HMQ based primary care experl ences ^for first year students, 
HMO based students were compared with students in other primary 
care settings as to: 1) knowledge of primary care and the 
doctor/patient relationship; 2) knowledge of a variety of modes 
of structuring health care delivery and 3) effect on career 
choice. The project structured' experiences which allowed students 
a maximum amount of direct contact with both health care providers 
and patients 1n the HM setting* Pre/post comparison showed 
small 5 but significant, differences within the treatment group. 
Evolution of student career choice and the 'imitations of meeting 
health manpower goals by curricular changis are discussed* 
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AN HMO BAS ED PRIMAR Y CARE CURRIC ULUM 
FOR FIRST YEAR MEDICAL STUDENTS - 
DESIGN. EVALUATION AN D DISCUSSION 

Although predicting that economic and social factors would 
be the most potent determinants of an Increase in the number of 
new primary care physicians, Alpert and Charney (1, p. 7) recog- 
nized the Important role of the medical school in this process. 
To Improve the preparation of medical students for careers In 
primary cars, they recommended (1, p. 62) that teaching and 
curricula be modified to Incorporate the following elements: 

a. criteria for selecting students who will be suit- 
able candidates for careej^s in primary medicine practice,'- 

b. , , . an overall program for primary care education at 
the undergraduate and graduate levels." 

c. "... sites for primary care education under (the medi- 
cal school's) auspices.*' 

Beginning 1n the fall of 1974, the University of Rochester 
School of Medicine and the Genesee Valley Group Health Associa- 
tion cooperated to design. Implement and evaluate a course of 
Instruction in primary care for undergraduate medical students 
In the spirit of these recommendations. 

At that time there were three competing prepaid health care 
delivery systems available in the Rochester area: an Independ- 
ent professional association^ a prepaid group practice based in 
a number of urban neighborhood health centers^ and the Genesee 
yalley Group Health Association (GVGHA) - a prepaid group 
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practice bdsed at the JosGph C, Wilson Center. It was felt that 
involving all or some of these community resources could improve 
the teaching of primary care delivery systems. 

The resulting project had two distinct phases^ one for first 
year and the second for fourth year medical students. The first 
phase of the project which is reported here, was developed in the 
context of a course offered by the Department of Preventive 
Medicine and Community Health during the Spring semesters 1975, 

Objectives and Biases: The objectives of the project *s first 
phase were design, apply and evaluate a curriculum centered 
around a semester long series of HMO based experiences for a 
limited number of students* It v/as postulated that such a 
curriculum would produce: (1) acquisition of knowledge about 
primary care and the doctor-patient relationship; (2) knowledge 
of simularitles and differences among a variety of modes of 
structuring hcdlth care delivery^ and (3) an effect on the deve1= 
opment of career Identity and student career choice plans. 

In designiny such an t^duGational experience a number of back- 
ground issues and biases came into focus. The first to be consid- 
ered was timing. Many faculty believed that' the earlier the expo- 
surSs the greater the impact on career orientation and subsequent 
career choice. However^ other faculty planners felt that first 
year students would derive only a limited benefit from exposure 
to patients at the HMO. In their judgement, the students had 
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insufficitnt knowledge of both the basic sciences and clinical 
methods to fully appreciate clinical problems- Another issue 
was duration! the bias of some faculty was that thirteen half- 
day experiences would not create revolutionary changes in the 
career plans of students. 

Still another consideration was structure. Frequently clin- 
ical learning experiences are unstructured and are dependent upon 
a variety of unpredicteu and unplanned circumstances such as the 
run of patients encountered at any time period^ the assignment of 
primary care physicians to serve as preceptors who must also main- 
tain their patient contact responsibilities, and the different 
roles assigned to students In various health care settings. Could 
the educational experience be made more even and predictable for 
all groups of students? 

Furthermore, objectives of primary care teaching are often 
vaguely articulated. Are these specific or unique things to 
observe and learn about primary care compared to traditional 
specialty based health care? Faculty of traditional departments 
often disagree on this issue with faculty based In family 
medicine or at the HMO. 

Description of the Program : Cognitive and affective objectives 
were defined. These included mastery of organizational and 
operational definitions of both the structure and personnel of 
primary care delivery systems. They also included detailed 
analysis and description of the processes whereby patients en- 
countered and were served by the HMO. Affective objectives, 
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deriviMi \ru\\\ a nuMiUur of btructurod as wgII as unobstrusive 
measursinents, inclNfipd students' attitudas tov/ard a variety of 
personnel encountered, and toward their experience of observing 
and pa rt1 ci pa ti ng in primary care . 

The course met one-half day per week for thirteen weeks. 
Each meeting consisted of three phases. The first 45 minutes 
individual students rotated through each of 11 units 1n the HMO. 
Interviewing the head of each unit. Following a brief lunch 
period, the group reconvened for a^seminar which presented the 
bulk of the pedagogic content of the course. Seminars were a 
combination of lecture by a content expert and discussion involv- 
ing the students. 

Following the one hour seminar, groups of three students 
dispersed to observe their physician preceptors at work with 
patients. This observation period lasted from one-half hour to 
several hours. In addition to these organized activities, each 
student was assigned a patient to follow through the duration 
of the course. The student was responsible for presenting a 
detailed case history of the patient* 

Using retrospective interviews of 1st and 4th year medical 
sLudents, Plovnick (2) found that both primary care experiences . 
and role models were influential factors in the choice of primary 
care career. The program reported here structured experiences 
which would allow students a maximum amount of direct contact 
with both health care providers and patients. This direct 



experience was to interact with the more abstract content pre- 
sented in the spminflps. The HMO's clinics, laboratories, 
administrative offices all became sites of teaching as well as 
patient care. The entire HMO staff was informed that the project 
was an important part of the ongoing activities of the HMO and 
were enlisted as ad-hoc instructors in their own area of activity. 

Eval uati on Des1 gn i A major constraint placed upon the evaluation 
of the project was the necessity of constructing a design which 
would not InterfGre with the pattern of instruction. As such* 
rindorn assignment of students to groups was considered undesir- 
able since it would Interfere with the student's self-determined 
pattern of interest. This initiariack of comparability among 
groups weakened the power of the evaluation design from the 
viewpoint of systematic research. However, it strengthened the 
design from the viewpoint of representative research (3)* there- 
by increasing its general 1 zabi 1 1 ty * The curriculum developed 
here will be applied in circumstances similar to our own, that 
is where students have an expressed personal interest in HMO*s. 
Therefore, subjects chosen by self-selection were more compar- 
able to those students with whom the curriculum will untlmately 
be used than If they were chosen by random selection. 

The resultant evaluation design was a non-equivalent con- 
trol groun model with pre- and post-testing, (4) For comparison 
purposes, tMrcc groups of students were tested. Group I were 
the 12^students at GVGHA's Wilson Health Center, Group II, 
called related, were 10 students parti c1 pati ng 1 n similar 
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activities at othtr prepaid primary care organizations* Group 
HI. called non-relatedp were 11 students serving at chronic 
care and social service fad li ties. 

The two basic goals of the evaluation design were first to 
quantify the cognitive and affective effects of the curriculum; 
and second to analyze correlations between demographi c/personal 
characteristics and outcome measures to identify possible pre- 
dictors of r:oani(J\/p anhievement or affective change. 
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ent attitudes were assessed by: 

An Osgood (5) type semantic differential which asked students 
to evaluate, as well as rate the potency and activity of the 
conceots of HMO. primary care physician^ medical school = 
nurse and medical specialist. 

A career choice questionnaire which asked students to select 
preferences of career typej practice type and specialty type, 
A semi "Structured i nterv 1 ew with which the evaluator inquired 
about the student*s reaction to the course's contents teach- 
ing and impact on their career choice. 
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Studont knowledge was assessid in the areas of: 

1, General concepts of primary care Including definitions of 
primary care^ family medicine, HMOp Urgent Visit Clinic and ■ 
Prepaid Group Practice. 

2, The functions of health care providers including primary care 
physlciani nurse practitioner, medical specialist, staff 
nurse, medical social worker^ medical secretary, medical 
receptionist, patient advocate, 

3, The contrasting structures of two types of health maintenance 
organizations Including financingi organizational hierarchy, 
marketing, hospitalization, and legal basis, 

4, The events of the physician-patient encounter. 

At the completion of the course, all students completed an 
activity summary in which they tallied: 

1. Number of patient meetings that they had had during the 
semester within the context of the course. 

2. Whether or not they had, as the result of their task force, 
developed an in-depth patient contact. 

3. The number of meetings with, health care professionals. 

4. Whether or not they had developed an in-depth contact with 
one or more health professionals. 

In addition to testing and interviewing, the project evalu- 
ator observed all seminars and rotations through the service 
units and several patient visits. This level of involvement was 
necessary to complement and validate the other sources of 
evaluative 1 nf ormation . 
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Re su! ts ; Analysis of covariance found significant betv/een and 
within group differences for evaluation of the HMO by the GVGHA 
task force on the semantic dlfferentiaK No other differences 
at the .01 level were revealed for the remainder of the semantic 
di f f eren t i al . 

(Table 1) 

Chi -square analysi s of the pre- and post-career choice 
questionnaires used the .05 level as the criterion of signifi-- 
cancG. For career type, at pre-test a large proportion of the 
GVGHA group expressed a preference for general practice. At 
post-^test this proportion did not change. However collapsing the 
two control groups in a pre vs post chi-square comparison revealed 
a shift towards general practice which was small but significant. 
For practice type, specifically HMO based practice^ there was a 
small but significant positive shift within the GVGHA group. 
For specialty type^ student selections of family practice^ 
pediatrics and internal medicine were combined into a single 
primary care category. At pre-test, the membership of the related 
group was significantly more inclined toward these p^^lmary care 
specialties than the GVGHA group or the non-related group. How- 
evarj at post-test^ the proportions of the other groups select- 
ing these specialties had increaseds so that the differences 
were no longer significant, 

(Table II) 

Analysis of covariance with subsequent t-tests revealed 
significant pre-post d1 f f erences *at the PN,01 level for the GVGHA 



6. 



group alone on two knowledge variables; general knowledge of 
primary care concepts and the structure of health maintenance 
organizations. Analysis of the other knowl edge variabl es i the 
activities of primary care staff and events of the doctor/ 
patient relationship revealed small but non-significant gains 
for a1 1 groups . 

(Table III) 

Analysis of variance among groups and Tukey's honestly 
significant difference test for between group comparisons were 
used to analyze the summaries of student activity. Overall, the 
GVGHA group had more patient meetings, more 1n-depth contact and 
more contacts with health care professionals than the comparison 
groups. The program succeeded in bringing students into contact 
with patients and care providers. 

(Table IV) 

Relative to the second objective of the evaluation, the 
1 aenti n cati on of demographic/personality predictors, Pearson 
correlation co-e^f 1 ci ents were computed for these student charac- 
teristics and all outcome measures across all subjects. An 
analysis of all correlations exceeding the .01 confidence level 
Indicated that students who have a high need for dominance as 
measured by the Edward's Personality Preference Schedule tended 
to rate the concept of the primary care physician as relatively 
low In power or potency. In similar fashion, students with high 
need for change tended to rate the concept of the primary care 
physician as low in activity. Home town size was also negatively 
correlated with students' concept of the activity of the primary 
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care pliyiician. These and the remaining characterl s ti cs and 
their ro^y^el at i ons contributed to a general profile of an agresS" 
ive, highly intelligentt science oriented, medicaT student from 
an urban environment who tended to view the medical specialist 
positively and saw primary care as a less Interest ing^ less 
Intellectually thallenglng^ less important career, 

(Table V) 

The rinal two sources of evaluative information^ the evalu- 
ator's observations and the semi -structured interview at the 
conclusion of the course verified the more formal ly . derived 
information presented here. 

Analysis and Comment : As anticipated, the HMO based students 
damgnstrated real gains in their knowledge of and attitude toward 
Health Maintenance Organizations, Also as anticipated, the 
experience produced only a limited number of shifts in individual 
career plans. The career choice results for all three groups 
showed a trend toward varying forms of primary care. But only 
Lhu GVGHA group framed this choice of primary care in the HMO 
context. These results are Interesting since all members of the 
related group were also involved in other forms of prepaid group 
practi ces . 

We suggest the causal bases for this more focused HMO prefer- 
ence among the GVGHA students can be found in their knowledge growth 
and their HMO/patient related activities. Analys'^i 'if the knowledge 
variables clearly indicated that knowledge of th-: cuiv^':ptual under- 
pinnings and day-to-day operation of prepaid groi':^ p ^.tice was 
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effectively conveyed to the students. Interviews of the GVGHA . 
students confirmed that their contact with patients and providers 
demonstrated the challenges and satisfactions of the primary care 
career . 

Althouah testing revealed the GVGHA students' mastery of the 
conceptual information presented in the structured presentat 1 ons 5 
it is their less clearly denions trated mastery of the concepts 
presented 1n the unstructured portions of the eKperience which 
may have greater implications for medical education* It was the 
unstructured experiences which presented that bulk of material 
relevant to. the students' knowledge of the events of the doctor/ 
patient relationship. In this areaj students showed great inter- 
est but little gain in knowledge. First year students have yet 
to master the full range of prerequisite basic medical sciences. 
They have had no exposure to pathology^ microbiology or pharma- 
cology. As a results they are probably unable to infer and 
understand the component processes of the doctor/patient relation- 
ship such as the physician's interpretation of the primary data, 
clinical reasoning and decision making. The comments of one of 
the medical students in the GVGHA group supports this insight. 
He stated that although he found his primary care experience 
surprising in its Intellectual challenge, it also served to 
emphasize his need to master basic science material to be 
effective in the role of the primary care physician. 

0S2 

o 

ERIC 



3^ 



Tho rol a ti ons h 1 p bo twcien cu rr 1 culum and ail tlma te career . ; . . 
choice is part of a largur process whereby .the evol v.iri^ 
develops his profes s i onal 1 den ti ty . Erikson (6) .suggests ^ that an; 
individual -s .Identity evolves through a process of experimenta'-, , , 
tion^ crys ta 1 1 i za t i on t rejection and reformulation* In this 
process^ the 1 ndl v1 dual i n effect "tries on'* a "success i on of 
identities and roleSp each in succession affecting and being 
affected by the others In the seqUerice. Even after the fridivid^ 
ual rejects a role as unsuited^ an appreci a tlbn or an understand- 
ing of that role remains v/hich affedts his subsequent choices as 
well as his overall career perspective. 

Such a conceptualisation of the devel opjnent of the physician 
identity negates many of the concerns regar.di ng the question of' 
indoctrinating medical students toward a .parti cul ar car.e.er choice 
If experiencing a variety of roles and adopting a series of tenta 
tive identities is a necessary process 1n ^the formation of a 
mature professional identity then medicaj education shp.u Id ^reco.g-, 
nize that the advocacy of a variety of career ;ty pes , wi thin the. ; 
educational experience Is a pos 1 ti ve benef i t to, .the. -medical . ... 
student. This logic suggests that this advocacy, shpul.d, not be a . 
bland pfesentation but instead shquld be presented v/ith ,all of 
the enthusiasm and detail necessary to^ induce student.s to ,.",try 
on'' a variety of roles^ perspectives and career p'l an s, 1n the 
course of their undergradua to experience, v;/ > , 
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The danger of Indoctrination is further mitigated by the 
recognition that students are not passtvi subjects but are re- 
active participants 1n the learning process. As such, they will 
critically analyze as wen as respect or reject the role inodjls 
they observe. Students will filter, select, defend themselves, 
and test the roles with which they are presented against their 
own personal ideals and their own developing conceptualization 
of what it means to be a physician. 

We recommend on the basis or our experience 1n this project 
that student work in primary care settings should hot be allowed 
to continue in Its traditional pattern of loose planning and un- 
controlled execution. Simply placing students on their own in 
the primary care environment, a situation similar to the related 
group in this project, Is not enough; When planned, executed 
and evaluated with the rigor of the best medical school courses, 
HMO based experiences or other primary care experiences can 
contribute to student learning. When they are not so planned, 
executed and evaluated, they produce frustration and serve to 
reinforce the weak intellectual Image from which primary care 



suffers . 

In their review of research on career choice Held and 
Zimet (7) report that career preferences expressed by first year 
students have low predictive value. The students in this project 
must therefore be followed to assess their ultimate career 
choice. Such outcomes will be informative. But the press to 
achieve contemporary health manpower goals should not obscure 
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the enf^Gntial function of the university: to aid the cJovgI opinen t 
of its studunts towdrd their full, self-defined potential. In 
this sense, no matter v/hat the outcomes in terms of career choice 
anything learned here or any attitudes changed, no matter how 
transient, v/111 not be completely lost. These outcomes have 
become a documneted part of the educational progression of twelve 
developing physicians. Intimate exposure to and knowledge of 
modes of health care delivery is in Itself a valid phase in the 
educational evolution of medical studentSi regardless of any 
demonstrated effect on ultimate career. 
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TADLE 1 



Summary of Sigmficant Results - Seven Point Osoood Semantic Differential 
bcale applied to Primary Care related concepts (Ancova controlling for 
pre-test with subsequent t-test analyses of differences) 



Var 1 able 
HMO : 



Group 



t-Test 
Pre Post 



Evaluation 11.06** GVGHA 

Rel ated 



Non-Rel ated 



Mean " 


SO 


Mean 


SD 


5.49 


.804 


6 .40 


.598 


5.72 


.829 


5.70 


.621 


5.27 


.770 


5,27 


.711 






**P < 


.01 



Non-Significant Variables: 
I HMO: Potency, activity 

■Evaluation, Potency, Activity Ratings of: Primary care physician, 

medical school , nurse , 
medical specialist 
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TAliLL 2 



Career Choice; Rcliitcd to Primary Care (chi square test) 



/ a r i n bA c 



Career Type: 
(Genrl . Prac . ) 



Pre 



4.945 
L .05 



Post 





1° 


Other 






10 


Other 




GVGHA 


4 


8 


12 


GVGHA 


4 


8 


12 


Rel ated 


1 


9 


10 


Rel ated 


2 


8 


10 


Mon-Rel ated 


0 


10 


10 


Non-Rel ated 


3 


7 


10 




5 


27 


32 


i 


9 


23 


32 



P = 



5046 

IS 



Practice Type 
(HMO Prac.)* 



Pro 



.9951 
NS 



Post 





10 


Other 






10 


Other 




GVGHA 


1 


11 


12 


GVGHA 


3 


9 


12 


Related 


1 


9 


10 


Rel a ted 


0 


10 


10 


flon-Related 


0 


10 


10 


Non-Related 


0 


10 


10 




2 


30 


32 




3 


29 


32 



P i 



5.5167 
.05 



Sp.ic i a 1 ty Type 
( F a rii . Prac., 



Pre 



P 1 



6.43 
.05 



Post 



Peds . , Int . ) 


10 


Other 






10 


Other 




GVGHA 


2 


10 


12 


GVGHA 


4 


8 


12 


Rel ated 


7 


3 


10 


Rel ated 


7 


3 


10 


Mon-Rel ated 


4 


6 


.10 


Non-Rel ated 


5 


5 


10 




13 


19 


32 




16 


16 


32 



X2, 
P 



2.933 
NS 



Career Tiype: 
(Gonrl . Prac. ) 

Group: Collapsed Controls 
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Pre 


Post 


10 Care 


1 


5 


Other 


19 


15 






20 



6 
34 



X*^ s 5.32 
pi .05 



i 



TABLE 3 



jdent Knov/ledge of Concepts 
itrolUng for pre-test with 



Related to 
subsequent 



HMO ' s and Primary Care (Ancova 
t-test analysis of differences) 



H abl e : 

I Organization 
tximum score: 16) 



mary Care 
eneral 
x1mum score 



taff 



Care 



XI mum score 



tor/Patient 
el ati onsh 1 p 
ximum score 



20) 



24) 



14) 



13. 28** 
G roup 

GVGHA 
Rel ated 
Non-Rel ated 

F 

8.19** 

G r 0 u p 

GVGHA 
Related 
Non-Rel ated 



F 

1 .51 



(NS) 
Group 

GVGHA 
Rel ated 
Non-Rel ated 



I 

1 .09 



(NS) 



GVGHA 
Related 
Non-Rel ated 



Pre 



Mean 



1 
1 
2 



75 
82 
00 



SD 

3.22 
1.66 
2.00 



Pre 



Mean 

4.92 
6.64 

5.55 



2.23 
2.11 
1.51 



Pre 



Mean 



SD 



8 
8 

8, 



08 
55 
55 



2 
3 
2 



02 
20 
70 



Pre 



Mean 

4. 92 
3.63 
5.64 



1 .78 
1.80 
1 .69 



**P 1. .01 



Mean 



7 
0 

4, 



58 
91 
00 



Pos_t 

i 

4 
1, 
4, 



SD 



25 
45 
23 



Post 



Mean 



9 
6 

6 



25 
45 
45 



2.49 
1 .44 

2.95 



Post 



Mean 



SD 



11 
9 
9 



08 
45 
00 



3 
5 
3 



03 
50 
26 



Post 



Mean 



SD 



6.92 2.91 
5.00 2.29 
6.81 1.89 



42** 

09 

19 



t 

69** 

35 

15 
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uiniiidry of student Activities (Ancova ainong groups, Tukey's USD Test between) 

*pf- .05 
**Pi .01 



ari abl e : 



number of 


F 










Patient Mtgs. 8 


. 75** Group 




N 


M_ean 


Sd 




GVGHA 




12 


24 0 


9 8 




Rel ated 




10 


4.2 


3.0 




Non-Rel ated 


11 


13.4 


16.0 


USD Test: 












GVGHA > 


Rel ated* 










In-Depth Patient 


Contact • 


F 








(yes = 1, No = 


0) 


12.1 










Group 




N 


Mean 


SD 




GVGHA 




12 


.75 


.45 




Related 




10 


.10 


.32 




Non- Rel ated 


11 


.09 


.30 



HSD Test: 

GVGHA> Related* 
GVGHA> Non-Related* 



Number of Contacts F 
w//Health Care Professionals 9.9** 



Group 


N 


Mean 


£0 


GVGHA 


12 


20.1 


12.5 


Rel ated 


10 


IS.l 


7.0 


Non-Rol ated 


11 


4.5 


4.7 



HSD Test: 

GVGHA> Non-Related* 
Related > Non-Related* 

In-Depth Contact F 
w/Health Care Professionals 10** 
(Yes « 1, No - 0) 



Group 


N 


. Mean 


SD 


GVGHA 


12 


1.0 


0.0 


Rel ated 


10 


.6 


0.5 


Non-Rel ated 


11 


.27 


0.4 



HSD Test: 

GVGHA > No.n-Related* 
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TABLK 5 



) 

mmary of Signifjcant Results . Correlations of denii ographi c and personal 
aracteristi cs (predictor variables) with outcome measures (dependent 
nables) across all subjects (pearson correlation Coefficient, all P 



Predl ctor 
Variable 

EPPS dominance 

EPFS change 

Home town 
population 
EPPS affiliation 
MCAT verbal 

Home town 
pdpul a ti on 

EPPS succo ranee 

EPPS change 
MCAT science 
MCAT verbal 

Home town 
popul ation 



Dependent 

Primary care physician ^ 
potency 

primary care p^^ysiciaj^ ^ 
acti V i ty 

primary care physician - 
activity 

Medi cai school ^ evaluation 
Medi cal special i$t ^ 
evaluation 

Medical special is* - 
evaluation 
Number o f Pa t i ent 
meet i ngs 



Nuniber of Hep 



meet! nqg 



Importance of pri^^^ry ca^e 

General concepts of pr1ma^^ 
care 

Events of Physician/patient 
encounter 



01 recti dn of 
Correlation 

negative 

negative 

negative 

negative 
pos 1 ti ve 

positive 

negati ve 

negative 
negati ve 
positive 

negative 
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Resource Paper No, 12 
EVALUATION INSTRUMINTS* 

A. 

C. 

D. 

•v 

* From the University of Rochester Final Report , ^ 

Project to Develop Curriculum for Physician Training in WLOb 
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Knowledge/opinion Questionnaire 



Career Choice Questionnaire 



Student Activity Summary 
Course Evaluation Form 
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Date 

Name/Nurnbor 
Undergrad Major 
Home Town Population 



MASTER* 

rMnW1.EDnH /OPINION OimSTTONNAIRI 



Define briefly the following terms: 

(4) a. primary dare 1 fipat omtact cares availMlityi oontinuin^ 

responsibility 'for managmentj basis of pre~pa%d group practice. 

(4) b. Faraiiy medicine, a pHmary oars specialty j confines med%Q%ne, 

peds, ob/gyn, Burgarys amtrasted to fmnily care proaesss debate 
over who should provide fmily care, 
(/,) c. Health Maintenance Organization i Another nme for prepaid group 
praotioei organisation providing oomprehen8%ve heaXih servvcess 
enrolled population- restrictive legislation. _ 

(3) d. Urgent Visit Clinic! Subsystem to provide cares ^o^^povn^ent 

neoessarys reoogniaes appoinPnenis cm interfere With health ^ 

(5) e Pre-paid group practice: Voluntary .association of profeesumcass 

prepayment of premiwns comprehensive medical cares group at risKs 
dual choice of member, 

; Describe briefly the function of tbe following health care personnel i 

(4) a. Primarv care physician-. aphysioimwhogi^esfCrstomta^ 

cares has responsibiU'^ for aontinuitys h%gh availab%Uty , basis 
of prepaid group praotioe. 
(3) b. Nurse practitioners: Ea, , additional diagnoatic sMU, %nde~ 

pendent professional, 

(2) c. Medical specialist: M.27., specialist travmng, 

(3) d. Staff nurse: Fwiotions Wider direcUons supportwe rather than 

independent roles R,N. or L,P,N, , _ ■ 

(3) e. Medical social worker: 4 sooial worker in a health care orgmi- 
sationj coordinates ootmmity agencies s works to reaolve social 
cmd mwironmental problems at patient's site of h^itation,^ 
(2) f. Medical secretary: A secretary who understands and oormmiioates 
iM -the language of medicines organizes patient aharta and records. 
Medical receptionist: Acts as patient advocates reoeivea me 
patients coordinates flm of patienta in the systems schedules 

patients. ' , . , 

Patient advocate: 4 spoUesperson for a patient or group oJ 
paHentss acts to represent the interests of patientas interprets 
the health care system to patients. 



(4) g. 
(3) h. 



^Answers to questions in Italics 
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3. DcGcrlbc and concrapt briefly the sUructure of two types of health 
maintenancQ organizatlono as to: financing, organisational 

c hierarchyi marketing, hospitalization > legal basis, 

m HMO typ eB 

^ n3 (16) Prepaid ^^roup practice^ Independen t professional assocj attons 

t. (inedical foundation) 

o 

Financing* a) pTepaymm%t on part of atient 

b) aontraat for G&rviaes ys* fee for servioes from 
pr&rrriiMit pool 

c) iniHal backing from government or private insurers 
Organizational 

Hlerarchys DeaentraZized aolleaiion of indep'sndent profesBionals 

Marketing: Scffne 

Hospitalization: Smie 

Legal Basis: Federal Law 

♦V 

Quality 

Control: Group at risk m%d peer reviei^ versuB no ri&k^ peer 

review only 

4. Describe in general terms what takes place in the physician/patient 
encounter I including' GKpectations each party holds for the other, 
kinds of data the physician uses, how a diagnosis is made. 



ExpeetationR : \ 

1# The patieJit approaches a physiaim with hie problems a^^d FiOliaits 
^ his help to resolve them, 

o 2* The patient^s need foi'^ help md the physiaim's aapcbitiP^ to^ 

help are the bases for initiating a relationahip, 
3, The physidm defines empliaitly and implicityly the aanditions 



ctf under which he am bast provide help* 



4* The patient attempts to establish the aanditions wider which he 



Qcm best convey his needs mid be asBured of help 

ou 



tf. 5* CorTwrunioation and a relationship are established* 



Kinds of Data: 

^ 6. ObserVatio?i of patient *s behavior md conduct during intem)iew 

+j md exmnination* 

o 7. Intervim, 



8. Physical mmaminatiofi^ 

9. Spcaial diagnostic exmninations , 
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10. The paUant'B rapoTt of peraeived phyHaat md/or hehaviofol 
ohmgeay and the phyBiaian 'a obaervaHonB of behavioral . 
md phijEiaat aharaoteHBUas ere uHlimd for first order 
nypotheaea, 

11. Hiipotheee are tasted by further intervim, phyaioal emanina^ 
t%on cmd laboratory apeai^l diagnostic proaedurea. 

ii' I pat%ent'8 problema are identified and alaaaified (Weed) 
J.J. bpoatf-to diagnones are made, 

14. Phyaiaim expects patient to beUeve d-Lagnosis md foltow 
inatrudt-iona . ' 

The followlni are a lisc of medical specialty areas which you 
niighC pursue. Please rank them in order of your personal pref- 
erence, from most favored _X_ to least favored 10 . 

Psychiatry Patholagy . 

• Internal Medicine panHy Medicine 

Oncology Cardiology 

— — Pediatrics ^ Preventive Medicine 

Orthopedics _^ Obstetrics /Gynecology 

The following is a list of health care eharaateristles. Please 
rank them m order from most iraportant _1_ to least Important 10 



_ Competency : Consistency 

Accuracy Safety 

Availability Comprehensiveness 

Frequency Equity 

— Economy Diversity 



X Ssllcancy Components 
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The follov/ina is a list of prof assionals * Pleaso rank thmm 
in order of your perception of their itnpor tance f rom 
most important 1 to least important 10 % 



High sohoal teacher 
L ci v: y e r 

Medical receptionist 
Ca rdiolon is t 
Nurse practitioner 



Dentist 
In ternist 
Nurse 

Diochomis t 
Electrical enqineer 



K Salioncy Components 



For each of the follovjinc?^ plGono 
indicating your perception of tha^ 

percoive tha rola of ^nurse practitioner as active, 

very active^ y^^u would check the form this v/ayt 



complete a semantic differontial 
role. For eKample^ if you 

but not 



Active 



Passive 



I 

He a 1th Main ten ancc Organ is a ti on 



GOOD 
MILD 
, ACTIVE 
INTERESTING 
HOHTIILESS 
STRONG 
SLOV? 
COLORLESS 
FAIR 
SHALLOV? 
RESTLESS 



DAD 

INTEM8E 

PASSIVE 

tJHlNTEHESTiMG 

VALUABLE 

V?EAK 

FAST 

COLORFUL 
UNFAIR 
DEEP 
OUIET 



Primary Care Physician 



GOOD 
MILD 
ACTIVE 
S^ITERESTXNG 
WORTHLESS 
ST ROM G 
SLOVJ 
COLORLESS 
FAIR 
SHALLOW 
RnSTLESS 



BAD 

INTENSE 

PASSIVE 

UNINTERESTING 

VALUABLE 

^EAK 

PAST 

COLORFUL 
UNFAIR 
DEEP 
pUIET 
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e. MecJioal School 



GOOD 
MILD 
ndTIVE 
INTEREST IMG 
UORTHLESS 
OTRONG 
SLOVi 
COLORLESS 
FAIR 
■ SHALLOW 
RESTLESS 



BAD 

IHTENSE 

PASSIVE 

UNIMTERESTING 

VALUABLE 

V^EAK 

PAST 

COLORFUL 
UNFAIR 
DEEP . 
QUIET 



GOOD 
MILD ' 
ACTIVE [ 
.INTERESTING 
' ■ TORTHLESS ' 
STRONG \ 
SLOH 
COLORLESS 
PAIR 
SHALLOM 
RESTLESS 



BAD 

INTENSE . 

PASSIVE 

UNINTERESTING 

VALUAELE 

t-iEAK 

FAST 

COLORFUL 
UNFAIR 
DEEP 
nUIET 



e. Medical Speaialist 

GOOD __ . . 

MILD — — _ _ ^ INTENSE 

ACTIVE ~~ ' . ^ PASSIVE 

INTERESTING — ~ " ~ " _ • — UNinTERESTING 

WORTHLESS _ . VALUABLE 

STRONG - . V^EAK 

SLOT? 1 • _ F'^ST 

COLORLESS ~ _ _ _ _ _ COLORFUL 

. FAIR ~ ~ _ _ _ _ WFAin 

SHALLOV^ ' ^ ^ ^ ^ DEEP 

RESTLESS " ^ OUIET 



. 0 97 



0- 



Desctfibe those Eactora which 
your community madicinG task 
and expectations. 



motivated you to select 
force. Incluac your ooals 



I 
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CAREER CHOICE nUESTIOinmiRE 



Presont yoar in medical school (circle . one) i - * 

lot 2nd 3rd 4th Internih'ip Other ' 

Chock the type of tnedieal career to which you believe you will 
ultimately devote all or rnost of your time, (Chdck one) 

- General practice 
Specialty practice 

Heseareh and/or teaching 

Combination of specialty practice^ research^ and/or teaching* 
^ Other (Specify) ' ' ' 

li^dicato the tyi>e of practice in which you plan to encrage* 
(Check one) * . 

I ' 
Individual private practice 

Partnership practiea ' ■ 

^ Private group practice 

- HMO practitioner 

Hoapital consultant (except federal hospitals) 
. Pull-timo taaching and research (practice confined to 
medical school hospital (s)) 

Part-time teaching and research/ part-time teparatd ' 

private or partnership practicOt 
Part'^time teaching and research, part-time separate 

group practice 
^ Federal government service 

Public health (with or without teaching and reeearch) 

If you plan to enter any type of career othc^_ than unsDOci aliped 
practice , please indicate the area in which you plan to apBcialir^e 
If your specialty area is not listed belovf^ but can be 
considered a sub-category within one of the fields that is . 
liotedp please check that field. Please check only one fields 

Family Medicine ^ . 



Anesthesiology 

Basic medical selGnces 

Dermatology 

Internal Modloinei a) subspecialty (apcicify) 

(ohack (a) or (b))- """" b) primary care internal mndicine 
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Neurology 

Obste trics/gynocology 

Ophthalniology 

Otolaryngology 

■ Pathology/cliniGal prnthology 

Pediatrics I (ahebk (a) or a) subopGcialty (specify) 
(b) ) 



b) primary care padiatries 



Physical inecUcal and rehabilitation 
Proc tology 

PBychiatry/nouropBychlatry 

Public health and prGventive r^Gdicine 

Radiology 

Surgory - g^ne-jral 

Surgery - neurological 

Surgery - orthopedic 

Surgery - plastic 

Surgery - thoracic 

Urology 

Cardiology 

other (specify) ' ^ 
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Task Force 



ACTI%'ITY SUHimRY ■ 

With hov; many patiGnts have you had contact of any kind (presentad in eiass, 
rounds, home, office) so far in your task force aisignmsnt? 

Please list the typGCs) of settings, nun^er (or frequency) and average duration 
of your interactions with patients 

Setting Number of Meetings Average Duration - 



. If you have developed a reintionship with a patient (s) ,in some depth {tv;o or 
more meetings) , please briefly describe the patient/ his/her problem, your 
activities relative to this patient, any significant knowledge you have 
gained, and any role you have played in the process of providing care to 
them. 
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Ploasa list the types of Jirialth care prof ossionalG (UCr) with whom you hnVG .M 
intcrnctcd in your tnuk forco aGsignmcnt, Inclicnte the scttincji numbar lor ' 
froquoncy) , and averiicto duration olf thoyo intciroctionr* : 

ProfeBsional Setting Number of MQetings Average Duration 



If you havQ worked v/itli a nCP(s) on more t\mn ono occassion during your t^sk 
force* ploncic doscri^.«a your interaction (s) in tGrrns of i (a) purpose , (b) setting 
(c) your rolD, (d) oppDrtunities to apply your scientific knowledge, and (e) what 
you; learned about the - HCP * s role • 



AAMC Primai-y Caro Study 
f ; COURSE EVALUATiOH FOm 

?vStudent 
; Group 

1.0 TGachinq - ' * 

1.1 Describe the inatruator's style of presenting ideas, 

1,1.1 Your preceptor's; 
1,2\ Were the claes presentations well organised? 
1.2*1 The clinical experiences? 




1.3 Was your preceptor accessible? 



1,4 Were your instructor's/preceptor's esq^ectations clear? 

2,0 Content s . 

2.1 How appropriate were the topics covered? 

2; 1.1 The elinical eKperiences? 

y 

2.2 Was the course content well organised? 

2.3 Was the level of detail appropriate?' 
2*4 What additional topics should be covered? 

2.4.1 Deleted? 



• " P^to Group 



3.0 Attifcudci 



3,1 Did the courso effect your atti^^*^® towa^^ choice of carcor? 
TOiy? 



3.1.1 Toward Priinary Care? vmy^ 

3.1.2 Toward medic^^ education? 

3*2 Do you think you wi^i choose additional eJ^ctives in primary care 
3,3 Did you choose to participate in the seco'^^ year ISP program? 



3.4 ^-mat aro thG most iniportarit cha^^^tQ^isti^® of primary care for 
the patient? 



3.4,1 For the physician^ 



4,0 Overall Evaluat ion'. 

4,1 \^at ware the best aspe^^s of th® e^^pcri^nce? 



4,2 Vmat were the worst. a^P^^ts? 
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Resource Paper No* 13 



PROPOSED EV^UATION INSTRUMENTS * 



EraiBIT lA, 
EJffllBIT IB. 



EHIIBIT 
EXHIBIT 
EXHIBIT 
EXHIBIT 
EXHIBIT 
EXHIBIT 
EailBIT 8 



Student Log Recording Form 

Sample Computer Prepared Suraaary Report 
Of Student Clerkship Experiences 

Student Progreas Report 

Student Course Evaluation 

Student Assessment of Preceptor and Training Site 
Preceptor Progress Report 
Course Achievement /Grade Report 
Patient Feedback ^to Students 
Site Visit Report 



* From Appendix K of the University of Washington Final Report 
Project to Develop Curriculum for Physician Training in IMOs 
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APPENDIX 3 : PROPOSED EVALUATION 
INSTRUMENTS 

EXHIBIT -la. STUDENT LOG RECORDING FORM 

EXHIBIT - lb. SAMPLE COMPUTER PREPARED SUMMARY REPORT OF STUDENT 
CLERKSHIP EXPERIENCES 

EXHIBIT - 2. STUDENT PROGRESS REPORT 

EXHIBIT - 3. STUDENT COURSE EVALUATION 

EXHIBIT - 4. STUDENT ASSESSMENT OF PRECEPTOR AND TRAINING SITE 

EXHIBIT - 5. PRECEPTOR PROGRESS REPORT 

EXHIBIT - 6. COURSE ACHIEVEMENT/GRADE REPORT 

EXHIBIT - 7. PATIENT FEEDBACK TO STUDENTS 

EXHIBIT - 8. SITE VISIT REPORT 
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/,;il,iiiilA 1, 



mi'M) iWiiialluii iilSlidiiWi:^ 



Surname of Student 



34 



1415 



16 



17iai92C 



0) 
VI 
L 
2 
Q 

y 



EKHlEITla, STUDENT LOG RECOK FOi 



iite.of 
,)(pinence 



Date of 
Experiinci 

Ho. Ui tr. 



21222324 



PROILEH 



I 



2S2 



L 

Q. nj 

y 4J 



2J2g293Q 



i 



31 



32 



3- 



SYSTEMS 



CLINICAL PROCEDURES, COMHUIITY COfjTACTS, PRACTICE MHENT 



40 



erIc 



u 



343E36 



p- 0 

■r OJ 

{/} ^ L 
□ 0 



•p 



3? 



PC 4I4E49 



I. iA^ 



Diagnosis 
Code 



i 



52 



§4 



5556§?5S 



.g. ...... 

•M is 

e s) 

3 0» 

i 

1 c 

UE 



E 

W 



ceduffi 

Code 



6061 



62 



62 



m 



373 

Please describe any noteworthy Impressions, anecdotes, triumphs, crisis, etc. 
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EXHIBIT lb! SAMPLE .WUTER PREPARED SUMiRlf REPORT OF STUDENT CLERKSHIP EIPERIENCES 
(Abbreviations EKplained on Previous Page) 



SITE OF EKPERIENGE LEVEL OF STUDENT RESPON. ONGOING OR NEW FREQ. DIAGNOSIS CODE AND NAHE 



0 


H 


HC 


NH 


ER 


PR 


AS 


OBS 


0 


N 






1 


1 


0 


0 


0 


0 


0 


I 


0 


2 


2 


500 PAP SMEAR 


3 


0 


0 


0 


0 


2 


1 


0 


1 


2 


3 


511 A ADULT RIN. PHYSICAL 

VI III flUWlii 11*111 1 IMWS V' 1 


1 


0 


0 


0 


0 


1 


0 


0 


0 


1 ' 


1 


5111 PEDIATRIC PHYSICAL 


1 


0 


0 


0 


0 


0 


1 


0 


1 


0 


I 


352A PRE/POST PART. EKAH 


Q 


3 


0 


0 


0 


3 


0 


0 ' 


0 


3 


3 


351 ROUTINE DELIVERY 


1 


0 


0 


0 


0 


1 


0 


0 


0 


1 


1 


J22 ADOLES. COUNSELING 


1 


0 


0 


0 


0 


0 


1 


0 


0 


1 


1 


586 FAMILY PLANNING 


1 


0 


0 


0 


0 


1 


0 


0 


1 


0 


1 


J04A MARITAL COUNSELING 


1 


0 


0 


0 


0 


0 


1 


0 


0 


j 


] 


283 HERNIA 


1 


0 


0 


0 


0 


1 


0 


0 


0 


1 


1 


242 SORE THROAT 


0 


4 


0 


0 


0 


? 


I 


1 


1 


9 

• 


ID 


240 UPPER RESP. INFECT. 


0 


1 


1 


0 


0 


1 


3 


4 


1 


1 


8 


183 OTITIS 

1 wy w 1 4 My 


0 


1 

1 


0 


0 


0 


1 


0 


0 


0 


1 

i 


1 


263 NOSE BLEED 


0 




0 


0 


0 


0 


1 

1 


0 

y 


1 

i 


0 


1 

1 


241 INFLU SYNDROHE 


2 


0 


0 


0 

y 


0 


0 


0 


2 


1 

1 


1 

1 


2 


398 RASH'NOT SPEC 


4 


4 


0 


0 

y 


0 


1 

1 


2 


s 

y 


6 


2 

It 


8 


3?2 BURNS ' 

y/ b uyiiiiy 


2 


0 

V 


0 

V 


0 

V 


0 


2 


0 


0 


2 


0 


2 


405 RHEUM ARTHRITIS • 


j 

t 


3 


0 


0 


0 


2 


2 


0 


1 

1 


3 


4 


480 SPRAIN 


0 


4 


0 


0 


0 




2 


0 

y 


3 


1 


4 


42§ LOy BACK PAIN SYNQ 


1 


0 


0 


0 


0 


0 


0 

y 


1 


1 


0 


1 

1 


400 CERVICAL PAIN 


3 


0 


0 


0 


0 


1 


2 


0 

y 


2 


1 

1 


3 


086 ASTHMA 

y wy ny n h in 


1 


0 


0 


0 


0 


1 


0 


0 


0 


1 


1 

1 


1?0 CONJUNCTIVITIS 


1 

1 


2 


0 


0 


0 


1 


2 


0 


3 


1 


4 


262 DYSPNEA 


1 

i 


0 


0 


0 


0 


0 


1 


0 


0 

y 


1 

1 


1 


26? UNDIFFERENT. COUGH 


2 


2 


0 


0 


0 


1 


3 


0 


4 


0 


4 


247 BRONCHITIS 


3 


1 


0 


0 


0 


1 


3 


0 


4 


0 


4 


255 CHRN. OBSTR. PULMON. 


] 

i 


4 


0 


0 


0 


4 


1 


0 


2 


3 


5 


246 PNEUMONIA OR OTHER 


1 


2 


0 


0 


0 


2 


1 


0 


2 


0 


■ 2 


mi mim 


1 


1 


0 


0 


0 


1 


1 


0 


1 


1 


2 


14? HEADACHE 


i 


1 


0 


0 


0 


0 


2 


0 


I 


0 


2 


134 DEPRESSION 


0 


4 


0 


0 


0 


2 


1 


1 


3 


] 


4 


155 STROKE 


] 


0 


0 


0 


0 


0 


1 


0 


i 


0 


1 


158 SEIZURE 


1 


0 


0 


0 


0 


0 


1 


0 


i 


0 


1 


195 CONCUSSION 


2 


0 


0 


0 


0 


0 


2 


■ 0 


1 


I 


2 . 


200 DIZZINESS 


2 


3 


0 


0 


0 


I 


1 


1 


4 


1 


5 


306 ABDOMINAL PAIN 



3lS 

-0 - 



AFPiiNnrxKi PRorosi;i) kvaluation iNSTmiMRNTS 

EXHIBIT 2i STUDENT PROGRESS REPORT 



Please dcscribo briefly how the Clinical Clerkship Is going from your point 
of view. We are especially incerested in (1) how you see your relationship 
with your preceptor developing (2) any problems you think are distracting 
£ rott your eKperlence* 



Please rate the following aad comment' 



Rfisponslbillty 
Coment : 



I I enough 



not anough too much 



Supervision 
ComLent : 



enough not enough too mueh 



Face 

Coment t 



□ ok 



rn too fast 



[ ) too si 



ow 



Eicposure and experience 
with problems 

Conment: 



enough 



j I not enough 



CQntinuity cxperlcncce adequate 
CoKir.eiit: 



not adequate 
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^ ^ ^ Exhibit 2 (Continued) 



family orientation □ enough ^ □ not enough 

' Cominenti 



Patient acceptance Q ok Q problams 

Comment i 



Offlca staff aceeptmncG Q ok problems 
Commant s 



Is this axperiaaca meeting your aKpeotations? 

y 



Please conment on the seminars » 
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APPENDIX K I PROPOKI!]) EVALUATION INSTRUMENTS 
EXHIHTT 3s HTUDENT COURSE EVALUATION 

DAT E 

NAM E 

(Print) 

COURSE EVALUATION BY STUDENTS 
CLINICAL CLERKSHIP 

To the Student s 

Your evaluation of this clerkship eKparience will be very helpful to the 
faculty in continually improving this clerkship. Thank you in advance for your 
participation. 

Check one box for each questlpn -' 

Are you in your thir d or fourt h year? 

What quarter did you take this clerkship? Fal l Winter Spring 

Summer^ • Yearj 19_ . 

Who was (were) your prlniary supervisor/s i . 



DIRECTIONS : 

Please circle the number of the scale (l^low and S^high) which best 
represents the extent to which this clerkship facilitated your learning with 
respect to the course objectives and each major eKperlence undertaken. 

There are a few open-ended questions at the end of the questionnaire for 
additional comments 
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EXHIBIT 3 (Continued) 



37^ 
-0- 



I. Course objectives I 

A. Please rate the extent to which the course objectives were: 



Not communicated 


1 


2 


3 


4 


5 


conmunlcated 


Unclear 


1 


2 


3 


4 


5 


clear 


Irrelevant 


1 


2 


3 


4 


5 


relevant 


Unrealistic 


1 


2 


3 


4 


5 


realistic 



[# To what extent did this course provide you opportunity to acquire knowledge 
and skills in the areas outlined below (representing course objectives)? 
Hate each item on the scale. If you are unable to evaluate an itemi indicate 
why in the space provided, 

CUNICM. GOALS Low High Cannot evaluate 

A. To gain knowledge and skills 
of coOTnon medical problems | 
in terms of % 



1, Which are cornnon im- 12 3 4 

portant problems 

2* Natural course of these 12 3 4 

problems 

3. Techniques of problem 12 3 4 
Identification, diagnosis 

and treatment 

4. Commonly applied preventive 1 2 3 4 
techniques for these problems 

5. Human interactions in the 12 3 4 
immediate environment which 

are important in dealing 
with these problems. 

B. To gain skill in: 

1* Interviewing patients 12 3 4 

2p Making appropriate judg- 
ments in terms of * 

a« Clinical problem solving 12 3 4 
by selection of historyi 
physical eKamlnatlon and 
laboratory data in terms 
of common high proba-* 
bllity of problem entities 

ERJC 410 



B. 2 (Cohf d) 



Low 



Referral to other 
medicnl disciplines 
verfiUH continued 
mnnngcmon L 

Recommend ln|* consulta- 
tion 



d* Referral to specif ic 1, 
agencies 

e. The Interval of folloW'^ 1 
up and the mode of follow^ 
up - the use of phone, re^ 
turn appointment I or by use 
of other personnel 

Maintaining clinical records 
which aid in problem-'Solving 
and provide continuity by: 




3 4 5 



3 4 5 



3 4 5 



a. OrganlEatlon of data 12 3 4 5 
which is readily com- 
municable to others 

hm Organization to assist 12 3 4 5 

in formulating diagnostic • 
and therapeutic plans 

4. Effective use of the tele- 1 2 3 4 5 
phone to record clinical dataj 

manage patients ^ make re- 
ferrals, and make consulta- 
tions 

5. Appropriate prospective analysis 
of risks to the health of 
patients bys 



EKLC 



a- identifying risks for 
the patient's immcidlate 
future 

b. Knowledge of measures 
that might reasonably 
reducu those risks 

C. To gain skill and knowledge 
in providing comprehensive , 
continuous health care on a 
longitudinal basis . 
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EXHIBIT 3 (Continued) 



PRACTICE MANAaEMENT GOALS Low High Cannot evaluata 

To gain: 

A, Knowledge of businesi 1 2 3 4 5 

applications in practice — =_ 

Knowledge of the types of 1 2 3 4 5 

office personnel and their 
role and contribution to 
the family practice setting 

C. Ability to establish appro- 1 2 3 4 5 _______ 

priate priorities In approach 
to providing medical care 

D* The "art" of peraonnel, 1 2 3 4 5 

staff I and peer relations 

E, Ability to outline realla- 12 3 4 5 
tic plana that provide time 
for self J family and com-^ 
munity involvement while 
providing continuous com^ 
prehenslve care for patients 

F* Ability to apply the prin- 12 3 4 5 
clples of cost effectiveness 
in health care delivery 

CO^P^ITY GOALS 
To gains 

A. Ability to identify the 12 3 4 5' 
major health hazarda in 
the community 

B. Ability to identify the 1 2 3 4 5 
appropriate role of the 
family physician with respect 
to these hazards 

G* Knowledge of persons other 1 2 3 4 S 
than In the hospital or the 
clinic in the community whose 
functions relate to health 
' or mediLcal care 

Skill in ability to work 1 2 3 4 5 
with other agencies 



ERIC 
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EXHIBIT 3 (Continued) 



HMO EXPERIRNCR GOALS 



To mini 



Low 



A. Knowledge of the function, 
theory 5 organizational 
structurei and legal and 
economic aspects of lIMO^s 

B* Knowledge of the differences 
between 1^10 -s and fee-for^ 
service settings In the use 
of common medical practices, 
Including I 

1# Telephone management 
of patients 



High Cannot evaluate 



2. Telephone consultation 12 3 4 

3p Patient referral 12 3 4 

4* Walk-in emergency 12 3 4 
service 



5 
5 
5 



Management of the 
health care team 



2 3 



Knowledge of the advantages 1 
and disadvantages to the 
consumer of prepaid medical 
service vs. medical insurance 



III* Please rate the extent to which the following activities were of value to you 
in helping you meet the objectives of the course and your own expectations* 
First, circle those which you experienced* Then, rate the quality of each circled* 
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Clinical Experiences 




Rate 


those 


circled 




1, Orientation 


Low 

i 


2 


3 


4 


5 ■ 


2, Initial patient work-ups 




•2 


3 


4 




3, Follow-up of patients 




2 


3 


4 




4. Labor and delivery 




2 


3 


4 




5. Major surgery 




2 


3 


4 


5 -V-v 


6, Minor surgery 




2 


3 


4 




7, Counseling patients 




2 


3 


4 


;< 


8, Counseling famiHes of patients 




2 


3 


4 


5 



:XIITUIT 3 (Continued) 




s. Low High 

- - - 
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9. 


Utilizing consultants 


1 


2 


3 


4 


5 


1 n 




1 


2 


3 


4 


5 


JLX • 


&inex^gency room csirtj 


1 


2 


3 


4 


5 


1 9 


un c&xx robacj^QnB 


1 


2 


3 


4 


5 


1 i 


^ (J L im_iiM sLJBL.^^X ^^v'WwUUI'WW fell*- wxr^^v^*^ 

or hospital (e.g., proctoscopies) 


1 


2 


3 


4 


5 


u. 


Rounds at the hospital 


1 


2 


3 


4 


5 


15. 


Staff meetings at the office 


1 


2 


3 


4 


5 


16, 


Library and other learning resources 


I 


2 


3 


4 


5 


17. 


Informal conferences with your CCU faculty 


1 


2 


3 


4 


5 


18. 


Formal teaching seminars with your CCU facult: 


f 1 


2 


3 


4 


5 


19. 


Other: 


1 


2 


3 


4 


5 


20. 


Other: 


1 


2 


3 


4 


5 


Conmunity Experiences 












IffiDICAL 












1. 


Alcohol and Drug Abuse Programs 


1 


2 


3 


4 


5 


2. 


County Medical Society Meeting 


1 


2 


3 


4 


5 


3. 


Hospital Staff or Coinmlttee Meeting 


1 


2 


3 


4 


5 


4. 


Medical Staff Meeting (Non-hospital) 


I 


2 


3 


4 


5 


5. 


Mental Health Group or Clinic 


I 


2 


3 


4 


5 


6, 


Other local community health agency or 
program 


1 


2 ^ 


3 


4 


5 


7. 


Planned Parenthood Clinic 


1 


2 


3 


4 


5 


EDUCATIONAL 












8. 


Local college 


1 


2 


3 


4 


5 


9. 


Local high school or grade school 


1 


2 


3 


4 


5 


10. 


Teaching of allied health personnel 


1 


2 


3 


4 


5 


11. 


Teaching of lay people 419 


1 


2 


3 


4 


5 



3^5 

EXHIBIT 3 (Continued) 



i 



Low High 

coirNTY ^ ' 

12. County Health Office, Public Health Nurse 1 2 3 4 5 

13, Welfare Department 1 2 3 4 5 ■ 

CITY 

14 * Chamber of Commerce 1 2 3 4 5 

15* City Government meetings 12 3 4 5 

16. City Maintenance 1 2 3 4 5 

17* Community met^tin^ on curent Issues with other 1 2 3 4 5 

non-health rolated a^^encies or groups • 

18. Local Law Enforcement agencies 12 3 4 5 

19. Local Court System 1 2 3 4 5 

20. Local Industry 1 2 3 4 5 ^ 

21. Other Infomal consultation with individuals 1 2 3 4 5 
(not patients) 

22. Service Clubs (Rotary ^ Lions ^ etc.) 1 2 3 4 5 

23. Special Programs for local minority groups ^ 12 3 4 5 
e.g. J migrants, natives 

24. Others ■ 1 2 3 4 5 j 

25. Others ^ 1 2 3 4 5 

C. Practice Management Experiences Low Hi^h 

Work with office manager, faculty or others 

regarding I - ' / ; 
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1. 


Answering Services 


1 


2 


3 


4 


5 




2. 


Billing procedures 


1 


2 


3 


4 


5 


= r',- 1,, 


3. 


Office or hospital audits 


1 


2 


3 


4 


b 




4, 


Personnel management, hiring/firing 


1 


2 


3 


4 




















5. 


Continuing Medical Education activities 


1 


2 


3 


4 


5 




6. 


Record keeping systems and forms 


1 


2 


3 


4 





















EXHIBIT 3 (Continued) 



7» Referral systems^ forms 

8* Scheduling patients 

9* Uie of dictating equipment 

10 i Use of telephone 

11^ Otheri " 

12. Otheri 



tow 








HlRh 


1 


2 


3 


4 


5 


1 


2 


3 


4 


5 


1 


2 


3 




5 


1 


2 


3 


4 


5 


1 


2 


3 


4 


5 


1 


2 


3 


4 


5 



Pleaae indicate how comfortable you felt handling the following types of patients 
or procedures* 



Well patients seeking health maintenance care 

^ at the beginning of the clerkship 

^ at the end of the clerkship 

Children with non--emergency problems 

^ at the beginning of the clerkship 

^ at the end of the clerkship 

Children who were quite sick or injured 

^ at the beginning of the clerkship 

- at the end of the clerkship 

Obstetric patients in normal pregnancy , labor 
and delivery 

at^ the beginning of the clerkship 

^ at the end of the clerkship 

Adults with non*emergency problems 

^ at the beginning of the clerkship 

- at the end of the clerkship 
Adults who were quite sick or injured 

- at the beginning of the clerkship 



Inadequate 

1 
1 



1 

1 

1 

1 



Q - at the end of the clerkship 

eric; 



1 
1 

1 
1 



2 
2 

2 

2 

2 

2 



2 
2 

2 

2 

2 
2 



3 
3 

3 

3 

3 

3 



3 
3 

3 

3 

3 
3 



4 
4 

4 

4 

4 

4 



Con fident 

5 

5 



4 
4 

4 
4 

4 

4 



5 

5 

5 
5 



5 
5 

5 
5 

5 
5 
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V: 

i 



EXHIBIT 3 (Continued) 



Performing dingnoiitic niicl thurnju'iiLic procadurgH, 
such as proctoscopy, cnsts, etc* 

at the beginning of the clorkshlp 
^ at the end of the clerkship 
Performing minor surgery 

in the beginning of the clerkship 
" at the end of the clerkship 
Traatinent of emergency room patients 

in the beginning of the clerkship 
^ at the end of the clerkship 

Counseling patients and families regarding health 
maintenance and psycho-'Social problems 

^ in the beginning of the clerkship 

at the end of the clerkship 



InadcqiinLc* 

1 

1 

1 
1 

1 

1 



Conf tdun 

— n 



2 
2 

2 
2 

2 
2 



1 
1 



2 

2 



3 
3 

3 
3 

3 
3 



3 
3 



4 
4 

4 

4 
4 



4 

4 



5 
S 

5 
5 

5 
5 



i 



V, What were the most beneficial experiences of this clerkship? 



VI. What were the least valuable aspects of the clerkship? Were there any Impprtant 
problems for you? 



VII. Do you have any specific suggestions for the faculty? 



VIII, What was your general attitude towards this clerkship? 



IXt Did this clerkship affect your career aspirations in any way? Yeo 
If so, how? 



No 



X. Do you plan to take further clerkships? Yes No ^ . If so, where?^ 
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APPENDIX K ; PROPOSED EVALUATION INSTRUMENTS 
EXHIBIT 4: STUDENT ASSESSMENT OF PRECEPTOR AND TRAINING SITE 

« 

Date I 

Dates of Clerkship i 

Loeatien of Clerkship 

YOUR NAMI (Optional) 

(Print). ^ ^ - 

PHYSICIAN FACULTY^ S NAME: 

(Print) - ^ — 

A. Pleasa indicate your pereeption of the quality of teaching and supeYV * 

you received from this faculty mei^^r by rating his/her performance i*; nha 
following areas; (circle one number on each scale.) 

Poor Average Superior 



1. 


Clinical Competence 


1 


2 


3 


4 


5 


2. 


Quality of Teaching 


1 


2 


3 


4 


5 


3. 


Interest in Teaching 


1 


2 


3 


4 


5 


4. 


Awareness of current literature 


1 


2 


3 


4 


5 


5, 


Relationships with patients 


1 


2 


3 


4 


5 


6. 


Relationships with students/res. 


1 


2 


3 


4 


5 


7. 


Attention to community problems 


1 


2 


3 


4 


5 


8. 


Ability to manage professlonai 
responsibilities, personnel, 
office, etc. 


1 


2 


3 


4 


5 


9. 


Effectiveness In maintaining 
quality control with reference 
to patient management. 


1. 


2 


3 


4 


5 


.0. 


The extent to which this faculty 
member was willing to give you 


1 


2 


3 


4 


5 



responsibility. 
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EXHIBIT 4 - (Guntlnucd) 



1. On a typical day, about how much time does your preceptor spend with you,^ 

2. Was the amount of time your preceptor devoted to you (in your opinion) i 

completely inadequate 
m inimal 
^ adequate 

g enerously adequate . 
too much 

3. Does your preceptor, have any qualities which you find highly desirable 

for a teacher of this course? Please - describe: 

4* Does your preceptor have any qualities which you find undesirable for a 
teacher of this course? Please describe: 

5# Are there characteristics about your preceptor's of flee (staff , space, 

patient miXj pace of work^ partners, location, etc.) which you find highly 
desirable in a teaching.slte for this course? Please deserlbe: 

6* Are there characteristics of your preceptor's office which you find 
undesirable In a teaching site for this course? Please describe: 

how would you rate your preceptor as a teacher in this course: 
poor 

barely adequate 

average ' 
good 

outstanding 

I 
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7, Overall, 
1. 
2; 
_3. 
4. 
5. 



EffllBlT 4 - (Continued) 



"^or^hls'^u^se"" preceptor's office a. a training site 

1* poor 

2* barely adequate 



^3* average 



^4 , good 



outstanding 



9, COM^ffiNTS: 
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APPENDIX K ; PROPOSED EVALUATION IMSTRUMENTS 
• EXHIBIT 5; PRECEPTOR PROGRESS REPORT 



FROM: 
SUBJECT? 



CLERKSHIP PRECEPTORS 
COURSE COI#IITTEE 
KEEPING US INFORMED 



Please tell us In a few sentences how the Clinical Clerkship Is ■progressing 
vflri-M"t of view. We are especially interested In knowing about (1) how 

'^^"^ your student is doing and (2) any pro W ems tlw^^ ■ 



Ve would also like to know how the preceptorship has affected your practice so far ' 

a. Productivity loss is about % or patients during the morning 

when the student is there. 

b. The student spends about (nlnutes, hours) per week in my practice. 

c. In addition to the student-contact time, I am spending about 

minutes per week planning, organlaing or: otherwise preparina for the 
student. ^ » . 

d. Any other ways, positive or negative, in which having a student has 
effected you or your practice? 



APPENDIX Ki PROPOSED EVALUATION INSTRUMENTS 
EXHIBIT 6 1 COURSE ACHIEVEMENT/GRADE REPORT 



STUDENT NAlffi^ 
COURSE ACHIEVMENT/G^E REPORT 



Clliiieal Goal.^ 

A. Exhibits knowledge and 
skills oft 

r 1* Which are aoim 

Impoiftant problems 

2. Natural course of these 
problems 

3. Techniques of problem identlfi- 
cation, diagnosis and treatment 



4, 
5, 



Commonly applied preventive 
techniques £ot these problems 

Human interactions in the 
iTOiediate environment which are 
important in dealing with 
these problems 



Exhibits skill in: 

1. Interviewing patients 

2* Appropriate judgment in: 

a* Clinical problem solving 
by selection of hlstorys 
physical examination and 
laboratory data in terms of 
. common high probability of 
problem entitles. 

bi Referral to other medical 
disciplines versus con-- 
tinued management 



f 








m 


m 






•H M 


m 


60 




4=» O 














*^ 


m u 


u 




6 


m m 


m 




O 


^ ^^ 


m 


1 


W 


1 


2 


^ 3 " 


4 


1 


2 


3 


4 


1 


2 


3 


4 


1 


2 


^'3 ' 


4 


1 


2 


3 


4 




Reeommendlng consultation 

Referral to specific agencies 

The interval of followup and 
the mode of followup - the use 
of phone^ return appolntraent, or 
by use of other personnel 
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u 
o 

u 



1 


2 


3 


4 


5 


1 


2 


3 


4 


5 


I 


2 


3 


4 


S 


1 


2 


3 


4 


5 



Not evaluated 
or do not 7 care* 



to rate 



'On 



^ ■ • . . . 

:^ 3, Ability to malntaln cllnlcal i h y Not evnluatel 

: . records which aid in problem P c feo ' ^ or do not car« 

= eolvlng and provide continuity m u eb m ^ to rata 

- - CO u M o " - - - . - - 

by s e £« > o ^ 

- ' • m ^4 m < ^ ^ 



brganiEation of data 
which is readily cor 
munlcable to others 



b* Organization to assist 1 
In formulating diagnostic 
and therapeutic plans 

4# Effective use of the telephone 1* 
to record clinical data^ manage 
patient^i make referrals s and 
make consultations 

5, Appropriate prOBpective analysis 



A« Has a general knowledge of business 
applications in practice 

Bp Has knowledge of the types of 

office personnel and their role and 
contribution to the family practice 
setting, 

G. Eschiblted abilities to establish 
appropriate priorities in approach 
to providing medical care. 

D» EKhlbited appropriate ''art" in 

personnel, staff, and peer relations* 

E. Exhibited ability to outline realistic 
plans that provide time for selfj 
family and community Involvement while 



care for patients, 428 



which is readily com- , 



of risks to the health of ' vv 

patients by: ^ 

a. Ability to Identify risks 1 2 
for the. patient 's immediate 
future 

b. Knowledge of measures that 1 2 
might reasonably reduce 
those risks 

C, ' Exhibits skill- and knowledge i 2, , 2 

providing comprehensive, continuous 



health care on a longitudinal basie, 
II. Pracjice Manag^ement Goals * 



'4 



providing continuous comprchonaive ; fy 



principles of cost effectiveness 
In health care delivery, 

^ ^orroiunity Goals 

A* Able to Identify the major health 12 3 4 

haEards in the comiunity. 



B* Able to identify the appropriate 1 2 

role of the family physician with 
"'^^^^ reispect tiS th^ 

C* EKhiblti a knowledge of parsons 1 2 

other than in the hospital or the 
clinic in the coiranunity whose 
functions relate to health or medical 
care. 

D. Exhibits skill In ability to work 1 2 

with other agencies • 



4 



Note special abilities, accompllahments or problems that the student displayed 
in the course • 
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^;;v-'rEtHiBIT 6 (Continued) 



II. 
iv. 



Body 0 f Me die a 1 Know ledge 
Aptitude 
Educabi 1 1 ty 
Hot! vat ion 



^^V* Personal Attributes 



A. 
B. 



Dependabll 1 ty . 
Initiative and interest, 
Llkeability. 

Communication and relationships 
with patients. 



1^ 

1 

1 

1 



Composure and ability to function 
under stress , 1 



Organization of t1nie and comni tments 



Vl. Potential of btcomlng a competent 
physician. " 



2 
2 
2 



2 
2 



3 
3 
3 



3 
3 



4 
4 
4 



4 
4 




1 










^ >% 


m 






o 
















m 




s. 




Oi 


u 












o 






m 




o 






£ 








1 


2 


3 


4 


s 


1 


2 


3 


4 


5 


1 


2 


3 


4 


5 


1 


2 


3 


4 


5 



s 
s 

5 



5 
5 



Hot Eva1ua.j||| 

or do not^^] 
care to ratt 



m. 



'J 



It Is understood that ratings given in this section will 
subjectiva impressions and judgments of the faeulty aval 



^ny additional comments * 



be based on i 
ua tor . 



M 



IRCLE ONE: Konors Puss Fail 
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FACULTY MEMBER 



mm 



APPENDIX K 5 PROPOSED EVALUATION INSTRUMENTS 



it;;*-;-/. 

u 



EXHIBIT 7s PATIKNT FEEDBACK TO STUDENTS 



ypu recently saw a medical iCudenc, Mr./Mi. , in my office. In an 

Igaffort to help students see themselves as patients see them, I would appreciate 
J|yout- answering sIk questions as honestly and constructively as you can. This 
P information will ba seen by the student for his or hsr own benefit and will not 
be used for grading purposes. * 

■IJTfianfc you, 

wO^^^yi b^t I can't remember the student well enough to answer* * 
ft ^' About how many times have you had contact with the student? 



I 



2. Do you (or would you) feel comfortable discussing your medical problems 
lAth the student? (Please elaborate,) 



3, Do you (or would you) feel comfortable discussing personal or family 
problems with the student? (Please elaborate,) 



4* Axe there any qualities or characteristics about this medical etudent 
which you find very appealing or important in the doctor you would choos 
(Please describe.) , 



5. Are there any qualities or characteristics about this medical student 
which you think he or she should try to change or improve in order to 
become more like the ideal doctor for you? (Please describe,) 



6* Is there anything else you think this student should know from a patient 
point of view? 



Thank you for your help. Your signature Is optional, 
r Sincerely p 



APPENniX Ki IMiOPOKHD EVALUATION rNHTlUIMieNTS 
EXHIBIT 8i SITE VISIT REPORT 



_SITE VISIT ACEh-DA 



^V. 1. Meet with Preeeptor and'StudenC in office. 

Diaeuss a) Longitudinal patient contacts ^- 

b) Corr* with basic science courses 

c) procedures in office practice 

d) of flea maaagement 




Look at print out 

review 

supervision 

responsibility 

other 



2* Watch student with patient 

Observer smoothness of relationship among student, preceptor and patient, 
review of charts , etc* 

3* Chat with other office .personnel 

Discuss 1) their irivQlvement with student 

2) ae^aaica of Integrating students into office routine 

3) solicit suggestions 

4, Feedback and impressions from Course Committer . ^ 
to preceptor, 

5, Site visit report filed here* 

6, Follow-up chat with student. 
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Measuring the Costs and Benefits 
of Medical Education In the HMO Setting^ 

Chrlitlne E. Bishop 

Innovative training programs for medical students and residents 

are currently being designed and mounted In health maintenance 

organization (HMO) settings. These programs will add a new dimen^ 

slon to the education of these students and residents , who will be 

able to learn at first hand how 'care is provided under prepaid 

goup practice plans. The programs will also open new opportunities 

for the HMOs, However * direct "involvement in medical education Is 

eKpected to have costs as well as benefits for an ffilO, and both 

costs and benefits must be evaluated before an HMO begins a training 

program. When all relevant aspects of the program are taken into 

account, it may be predicted that the value of benefits minus costs 

2 

is negative, so that the program has a net cost to the miO and 



* This paper was prepared for the Association of American Medical 
Colleges HMO education project. It draws upon the work of the medical 
sehool^roiO teams participating in- this project , as reported at a 
conference September 29 , 1975; the presentations of Gregory Pawlsoni 
Richard WatkinSj and Robert Lawrence were especially helpful* This 
paper has benefitted from comments on earlier drafts by Michael 
Lawsons Harold Luft, and Marcel Infeld. 

The author Is Assistant Professor of Economics, Boston University 
School of Management, 

2 

Definitions of technical terms defined and used in the text 
are reviewed In a glossary in the appendlKt 
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should not be undertaken; or that the program has a positive net 

benefit to the HMO and should be adoptGd. Clearly th© determination 

of net cost or net benefit must rest on more than prediction of 

money eKpenditures for the operation of the training program* The 

value of other coats and benefits are relevant as well. It is 

important that the individuals responsible for deciding whether an 

HMO should undertake an education program (referred to here as^ 

3 

"the HMO daclsionmaker" ) have enough information to make a wise 

i 

choice I otherwise s very costly programs may be started which cannot 
be continued^ and others with a net benefit for the ffilO may be 
mistakenly rejected * The HMO decisionmaker must determine which 
aspects of I the proposed education program have an impaet on the 
HMO's operation; how these impacts are to be measured | and how these 
costs and benefits are to be weighed against each other to determine 
whether tht program is on balance worthwhile for his HMO, 

It is 1 the purpose of this paper to discuss these questions, in 
-order;? Information may be provided to the VMO decision 
maker considering an education program* The focus here is on pre*^ 
diction of costs and benefits from the. point of view of the HMO. 
It is hoped that the methods developed by the AMIC project and 
applied for evaluation of its experimental programs can also aid 
other ffi^IOs in predicting the costs and benefits of Involvement in 



3 

Depending on the way the HMO Is constituted, the decision may 
be made by an administrator, the medical staff » a board of dlroctors, 
the membership at InroCf or some comblnntlon of these. For enee of 
eKposltloni the indlvldunl or group rusponsible for the decision will 
be referred to as "he". 



education. In Section I belowg the coste and benefits relevant to 
the HMO are defined, and a discussion is presented conceming how 
these may be used to determine whtther a training program Is worth-- 
while for an HtIO* In Section II, potential sources of coits and 
benefits are discussed, and means are proposed for gauging their 
Impact. 

J" 

I , Issues in Cost-^Benef It Analysis for an VMO 

A declelon about undertaking a training program will be based 
on evaluation of costs and benefits that are relevant to the IMO. 
These must be defined In light of the HMO*s goals and objectives s 
a cost Is any impact of the program which hinders the WiO In the 
achievement of Its objectives, while a benefit Is a positive effect 
on the roiO* When costs and benefits are measured in the same tarms 
(for example in dollars) costs can be subtracted from benefits to 
find a net benefit figure, Equivalently , the net cost of a program 
is calculatod by subtracting benefit from cost. By definition, 
a program with a positive net cost has a negative net benefit; these 
concfipts are analogous to loss and profit for a :.'lm. Since It may 
be vt^ry difficult to measure all Impact of a proftrara in the same 
termsi we may have to be satisfied with presenting the decisionmaker 
with measurements and estimates of a program's Impact on a niunber ef 
dlmeneions, leaving him with the problem of evaluating how much each 
cost and benefit is worth to the mO. » 

4^f7 



It should bn timpha.'ii ^ad at the outset that 'ahalysia of the costs 
and benefits of a tGaching program will be done on an IncrQniental 
basis: the situation before and after the introduction of the program 
is to be compared, and Its net impact, which may be positiva (a net 
benefit) or negative (net cost) is detprtnlned* 

A, Relevant Costs and BencEits , ^ 

The costs and benefits that are important to the HMO decisionmaker 

are restricted to those that have an impact on the achievement of HMO 

objectives. The term "cqst^benef it analysis" is often employed to 

mean the determination of social costs and benefits for use in 

4 

deciding whether a new public program should be introducedi Ideally^ 
the social boncflts of a program are weighed ftigainst its social costs. 
If the benefit to society eKceeds the costi the program is worthwhile. 
However J the Individual firm or organiEation can also use cost--benefit 
analysis j , when the analysis is geared to its own goals and needs* In 
the case at hand, the HMO decisionmaker implicitly follows the rule 
that benefits to the HMO must equal or exceed its costs; both costs 
and benefits measured in the light of the HMO's objectives* It is 
not appropriate to expect him to consider all the costs and benefits 
to society or the costs and benefits to other organisations , like 
medical schools or other HMOs, For example * the following may be 



For a comprolicnslve review of cost-benefit analysis s see 
Leonard Merowits? and Stephen SDsnick, The Budj^et's New Clothes ; 
A _C_r i t iquo Q f p lanii i n g-rro o ram lUidj ietin g an d R c n e C j t Co s_t An al y s i s | 
Chicago! Markhamr 1971. 
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seen as potential Inipacte of the training program, and thui candidates 
for a list of cost and bgnefit measures | however, only some of them 
are relevant to the HMO decision. 

1. change in dollar outiays made by the HMO for labor, 
supplies, plant, md equipinent 

2. change in the attitudes of current and potential 
physician and other staff members toward working 
at the mo 

3. changes in the value to current HMO members of 
the health care provided 

4. change in the rate of growth of the IMO 

5. change in dollar outlays made by the medical school 
involved In the program 

6* changes in the dollar and time outlays made by 
students for transportation to their training site 

7* change in student's satisfaction with their medical 
education program 

8# diversion of residency candidates to HMO training 
from other specialty training, or from other 
alternatives 

9. change in the attitudes of future physicians toward 
work in an HMO setting 

10, change in the attitudes of future physicians toward 
provision of primary care* 

Items 1 through 4 clearly Involve potential costs and benefits that 

the HMO decisionmaker should evaluate! the remainder are simply not 

relevant to an internal ffilO decision about program adoption, although 

they may be relevant to other decisionmakers* For example, changes 

in the dollar and time outlays of medical students, skills and 

attitudes they acquire and their satisfaction with the total medical 

education program may have an Impact on the cost to society of 

physician training, and may also have an impact on the achievement 
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of medical school objectlvea; however, these aspects of the training 
program are not costs and benefits to the IIMO, and are not relevant 
to its decision about undertaking an education program* 

B. Arriving at a Net Benefit (Net Cost) Measure , 

Ideally, the various costs and beneflte should be measured in 
slinilar terms, so that the HMO decisionmaker can determine whether 
benefits exceed costs. This can only be done if we know what these 
benefits and costs are worth to the IMO. This would not be such a 
difficult problem if the MO were attempting to tnaKlmize profits; 
predictions of revenue gains or losses and predictions of increases 
or decreases in expenses would put the analysis directly Into dollar 
terms, so profit or loss due to the program could be calculated. 
However, non=profit IMOs probably have different objectives. The 
relative weights placed on various benefits and costs in determining 
whether benefits exceed costs must depend on the HMO's goals. For 
example, suppose that the teaching activity increases expenses so 
that yearly premium per member must increase by a dollar, while the 
physicians providing care in the IMO are overwhelmingly in favor of 
the teaching "'program; there is no change in the quality or convenience 
of care as perceived by the members. How should the money cost to 
members be weighed against the increase in satisfaction to the 
physician staff? If the \lblO is run as a physicians* cooperative, so 
that benefits to the physicians are highly valued, it is likely that 
the teaching piogram will be accepted as having a net benefit to the HMO. 
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Howeveir, if the IIMO is run to maximize the benefit to membctB, the 
teaching program may well be rejected as having too great a cost to 
members for the , benefit they receive. 

Other aspects of the mo's goals become important when other 
potential costs and benefits are coniidered. k teaching program 
might raise costs now while enhancing long run growth prospects | or 
a program might appear to be costless while requiring so much 'extra 
effort from physicians and other staff that turnover increases and 
salaries have to rise. Members may dislike the presence of medical 
student observers, while the staff enjoys having them aroundi members 
may value the fact that their mO is now affiliated with a medical 
.school, while complaining that the teaching program is driving up 
premium costs. Unless strong assumptior,ftr&re made about how the 
HMO values these conflicting costs and benefits, it will not be 
possible to make a technical determination about whether benefits 
exceed costs. However, this by no means implies that benefits and 
costs that are difficult to measure and evaluate should be Ignored 
• as "subjective" and somehow unreal. When presented with a set of 
predictions about the various positive and negative Impacts of a 
program, the decisionmaker will come up with a yes or no answer; 
he implicitly makes the tradeoffs among the conflicting costs and 
benefits, even if he cannot specify a figure for the net cost or 
net benefit of the program to the IttlO. 

In the discussion of specific costs and benefits in Section II, 
an underlying assumption has been made about the objectives of the HMOt 



¥0£ 

that it is maximizing not bGncfits to mainbcra'. This implies that 
if members' yonrly premium rises by a dollar, there must be a compen- 
sating dollar's worth of benefits to members! if staff satisfaction 
is increased by the progrnm, this is a benefit to members insofar as 
it is translated into lower salary costs or recruiting costs j and thus 
into lower promium costs, or into higher quality of care for members. 
The HMO decisionmaker is assumed to choose to start a trainings program 
only if benefits to members eKceed costs to members > Of course * if a 
particular MID has a different objective, benefits and costs will be 
measured and evaluated in a somewhat different light* However, the 
list of probable sources of costs and benefits will not be much 
different from the list that follows, A decisionmaker with a 
different set of objectives for his HMO could use the same information 
although he would evaluate it differently and could arrive at a 
different decision, 

II, Costs and Benefits of Education Programs 

Following the rule that the IMO should undertake a program if 
its benefit exceeds its cost requires incremental analysis, which 
compares the "before" and "after" pictures of ittIO operation, without 
and then with the training programi what has changed? do the changes 
have a net beneficial effect? In this sectioni potential Impacts 
induced by a training proGram will be discussed. The most straight-- 
forward impact of education is increases in dollar expense due 
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directly to the programi for example residents' salaries and expen- 
ditures on teaching materials anS extra furniture for program partici^ 
pants* No less real is the cost of changes in the use of resources 
which the HMO would be purchasing anyway i no increase in dollar 
expenditure occurs ^ but conference rodms are used for students rather 
than for staff meetings, administrators plan programs and give lectures 
in time they would otherwise spend on administrative tasks , arid so on. 
This shift in resource use must reduce H>10 output ^ if these resources 
were being used at full capacity before the teaching program was 
Introduced, The question lS| what is the worth to the M o£ the 
resources diverted from other uses into teaching? ^e most interesting 
aspect of this question concerns the production of patient care without 
and with teaching I clinical teaching goes on simultaneously with the 
production of care, so that It is not possible to distinguish between 
resources going Into teaching and those going into medical care for the 
patient. This does not mean that clinical teaching is costless: it is 
likely that the output of a given set of health care resources will be 
dlfferont before and after teaching Is Introduced* For example, less 
care may be produced because the physician or nurse takes time to 
discuss cases with the student observer, or more care may be producad 
when a resident is added to the existing health care team. This 
Increase or decrease In the productivity of health care inputs must 
be evaluated. Other potential Impacts of teaching programs are 
changes In recruiting costs and staff satisfaction. Finally, It must 
be recognized that care without teaching may be worth more or worth 
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less to liWO mcinbera Lhan care with LcnclrinB; the members' perceptions 
of the amenities, convenience, and quality of care may change 
positively or negatively* 

A. PQilar expandltures for reBldents' ealarlas and educational supplies. 

Residents' salaries will increase the eKpenses of the HMO. A 
medical education program may require the purchase of specialized 
Instructional materials and equipment, like bookie reprints, KeroKed 
handouts, audiovisual aids, and classroom or study area furniture. 
These outlays add directly to \M0 costs* 

Data required I total residents- salaries and fringe benefits; 
quantity and price of materials and supplies; amortized value of 
equipment purchased for educational purposes* 

B* Diversion of res ources to use in teaching , 

Wlien resources are diverted from the production of health care 
to teaching, comparison of the situation at the HMO without and with 
teaching (incremental analysis) will show that some output is lost. 
It is assumed here that the IIMO will have to replace the output lost 
in order to maintain Its level of health care, so that output losses 
are valued at their incremental replacement cost* This Is a part of 
the cost of teaching activity. 

1. Space used for classroom teaching* The teaching program 
will increase the current cost of providing care for the roiO's member- 
ship insofar as it diverts conference rooms > study areas, and lounges 
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from other productive uses. Ideally, an estimate of the cost of 
replacing output lost is required. However^ a rough estimate of the 
value ©f space diverted from other uses might be calculated using the 
proportion of time the students use the conference rooms and so on 
and the cost of building space par unit time. 

An interesting question Is raised when space is used in teaching 
that has no other use for the mO. In some experimental programs, 
students' nonclinical activities have not displaced administrative 
or direct production activity, so that the cost to the HMO of serving 
its membership is not increased by student conferences , lectures, 
and the like. In other words , the cost of this space Is zero at 
present. Nevertheless, It may still be appropriate to count a 
portion of the HMO's space cost as a cost of the teaching program^ 
since In the long run, with optimal use of building assets, more 
space will be required with the teaching program than without it* 
It should be emphasized that these costs would not affect a short-run 
decision to start a training program. 

Data required: amount of building space used by students^ 
current utilisation by miO activities; student utlllgatlon rate| 
estimated cost of space per unit time* 

2. Staff time used for classroom teaching. Physicians, 
nurses, administrators, and other personnel may be diverted from 
their usual tasks to provide classroom teaching, i#e. lectures and 
discussions with students* Some staff may also be Involved in planning 
and administration of the teaching program. Wlien these manpower 
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inputs have hlohjy spccinii^nd funciLlons within the HMO, this time 
may have a very high value in terms of produccion losti when the 
chief administrator and head nurse take time away from tasks that 
only they can do, the operation of the HMO must suffer. The value of 
these specialized Inputs is probably more than they are paldp but 
at least their oalary rates can serve as minimum estimates of the 
value of their time. Other manpower inputs used for classroom' 
teaching can be seen as more replaceable; the value of production 
lost when a staff physician or nurse meets with students can be 
restored by hiring a part-^time physician or nui^se to fill in* The 
cost of these inputs Is their salary rate. 

Some ceaching occurs outside the clinical setting and outside 
the time that staff would ordinarily be paid. If physicians choose 
to devote lunch hour time to students, or stay after hours to talk 
with them, it might be argued that this time should hot be valued 
at the wage rate, becuase it need not be replaced at this rate; when 
physicians choose to spend their "personal time" in this way, it in 
no way diminishes the product of the HMO or adds to Its expenditures 
on inputs. However, this time should not be seen as free in the long 
run. If the HflO implicitly includes this kind of "volunteer" 
effort 'n its physician job description, it will eventually have to 
be paid for. If more rewaTding uses of personal ' time appear, or if 
the teaching program expands to include physician=taachers who are 
not so philanthropic, either the teaching proGram will fall In 
quality or costs to the HMO will indocd rise. Predictions about 



the long run value o£ personal time inputs to a particular HMO 
should be made by the decisionmaker on the scene, but should probably 
be set near the current salary rate. 

Data required: number of personnel engaged In classroom 
teaching and administration by type; hours of student contact, 
preparation and administration ; salaries. A distinction may be made 
between "regular" and "personal" time if the use of personal tiime 
resources is believed to have a lower cost for the HMO. 

3. Clinical Teachings production gains or losses. The 
most important impact of an education program on the HMO is likely 
to be due to production losses or gains in the clinical teaching 
setting. A set of inputs (for example, 1 physician, 1 nurse, h 
receptionist, 2 examining rooms, etc.) ordinarily produce a certain 
average number of patient visits in a session of a certain length. 
The addition of a student observer or participant to this health 
team may decrease or increase the number of visits produced per 
session. The most straightforward way to evaluate the cost of a 
loss of production is to find the Incremental cost of replacing the 
lost visits. If visits per session drop from 14 to 12, and the 
incremental cost of adding an extra session (not counting expenses 
that vary directly with patients served) is $100,, the cost of lost 
production in each student session is approximated bys 

^ifiS X 2 = $14.28. 
14 

Our cost calculations here must consider both the direct cost of 
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adding n scHsion (linlary payments of workers dirGctly involved in 
producing paticnc care) and variable ovnrhoad (additional reception- 
ist time^ maintcnancG of examining rooms in use for one more session ^ 
liglit and hcatj etc.)* Tlie Incremental cost per session does not 
include costs of marketing, general administration, pharmacy operation ^ 
and the like, since these fixed overhead costs are not Increased by the 
addition of an extra session. Supply and variable laboratory expenses, 
which depend on Che number of visits produced rather than on the number 
of sessions held, are also not included in the incremental cost per 
session. Thus the measure for the replacement value of lost production 
is somewhat less than the average totar cost per visit 

^ Expansion of the numerical example may make this argument Tnore 
clear# Assume that current membership of 40,000 can be cared for with 
an average of 2800 visits per week, and average number of visits per 
session is 14* This implies that 200 sessions per week must be 
scheduled , 

2800 visits per week . , 

\, . ,^ — ^ ^ 200 sessions per week 

14 visits per session ^ 

If students participate in 28 of these sessions, visit production in 
these 28 sessions will be reduced, with total visit production now 

(200 - 28) x 14 + 28 K 12 ^ 2744 

sessions productivity sessions productivity 

without without with with 

students students students students 

where the visit production with students present is 12 per session. 
The 11>I0 is now 56 visits short of its previous weekly level of service. 
To replace the visits lost due to lower productivity, four sessions 
must be added* 

56 visit deficit 



14 visits per session 



^ 4 sessions 



If it costs $100 to add another session, not counting costs that vary 
with visits, an outlay of $400 is required to bring the H^IO back to 
its previous service level. 

It is important that a distinction be made between costs that 
vary with visits produced and those that va^ with sessions scheduled. 
If a pncient visit on avorago requires about $2 worth of supplies, 
laboratory tests, and drugs, the cost of thesa inputs for 2800 visits 
will be $5600 whether the patients are seen In 200 sessions ^without 
the teaching program) or 204 (with the program). 



In like fflannor, if residents increase the number of visits the 
health care team can produce, fewer non-teaching sessions will need to 
be scheduled. Assume that a resident and a physician working together 
with other direct patient care inputs can produce 20 visits In a session. 
The value of the six extra visits may be estimated by determining how 
much they would have cost if produced In a typical session. In the 
example, the cost saving would be 6 x $7.14 » $42.84. This will eventually 
be weighed against the stipend paid to the resident, which is ^Included 
as an Increased expense in part A above. The value of the residents' 
total production may very well exceed their stipends, even when lower 
productivity in some sessions Is taken into account. 

If residents see patients on their own, their impflct on costs and 
production can be evaluated In a similar way. Assume that a resident 
working with a nurse and other inputs can see nine patients in a session. 
This is an increase in production which the IMO would not have without 
Its teaching activity. Valuing this at its replacement cost of $7.14 
per visit, the value is 9 x $7.14 - $64.26. But this increase in 
production could not occur without expenditure on the other Inputs 
Involved I if these cost $40 per session, the resident Is making a net 
addition to production worth $64.26 - $40 = $24.26 per session. This 
calculation in effect takes into account the fact that the other health 
care inputs would be more productive working with a staff physician. 



^ Another way of looking at this is to see the HMO as replacing 
a regular session with a resident session. The resident combines with 
$40 worth of Inputs to produce 9 visits; paying « staff ^physician plus 
the other inputs cost $100. or $60. more, but produced 5 additional 
visits. The resident has saved the HMO $60. and lost 5 visits, which 
will cost 5 X $7.14 » $35.70 to produce in a regular session? the HMO 
is $60. - $35.70 ' $24.30 ahead. 
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It should be noted thnt the nbovo approach to the costs o£ loat 
or gained production asaunies that care for, the pppulation is being 
pravided efficiently at prosent, so that a decrease in the number 
of visits per session must be accompanied by an increase in the 
number of sessions while an increase in visits provided will allow 
a decrease in the number of regular sessions. 

Since the output of the WJO is not patient visits but care for 
a population, a more complete productivity measure would consider 
the number of individuals that can be carried by a typical teaching 
and a baseline nonteachlng health team. This productivity measure 
would allow for the poasibility that teams including students or 
residents may produce a higher proportion of return visits 5 so that 
loss in productivity as measured by members served may be even 
greater than loss in productivity measured by reduced patient visits. 
Such a measure would require a baseline count of the number of members 
cared for by each teamj and the change in that number due to a given 
amount of teaching invo3,vement , If teams including students or 
residents use more supplies and laboratory tests per patient than do 
nonteaching teams* the resultant increase in cost should be charged 
to the teaching program, , 

Data required: baseline productivity for specific input combin- 
ations, measured in terms of patient visits and/or members cared for; 
productivity of the same input combinations when involved In 
teachlngi incremental cost per session under baseline or standard 
production methods, not including supplies and tests that vary 
directly with patients seen; this would require collection of data 
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on salaries for all staff invQlved, sUnff Input in hours, and 
allocation o£ variable overhead costs (c^:amlnlng roomi i equipment , 
receptionists I heat and light) per session' inveitigatlon of possible 
increases in use of supplies or laboratory tests per patient visit 
by teaching teams, and cost per teaching session of this excess use, 

C, Staff satisfaction and effort ^ 



Staff involved in teaching both in clinical and nonclinical 
settings may gain extra satisfaction from this activity , and may 
feel that extra effort is required of them. Over the long run these 
effects are expected to show up in salary offers necessary to attract 
staff to the IMO, These salary changes will be difficult to predict^ 
but the presence of these effects and their strength can be approxi- 
mated by surveys of staffi Surveys should include questions about 
whether staff currently involved in teaching have an overall preference 
to return to their pre-teaching job content, or prefer the teaching 
activity; and whether teaching Involvement would be a job attribute 
they would actively seek if they changed jobs. 

Data needs: staff surveyi_to determine changes in effort 
level and satisfaction level with and without the education program, 
and to determine how the staff evaluates these changes. 

D. Recruiting cos ts 

If teaching activity adds to the general satisfaction and prestige 
of working at the im (in addition to increases in direct personal 
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sfltlsf action, discusBcd nljovc In parU C) It will bo easier to 

tecrult new physicians and other staffs quality of job applicants 

may rise, salary offers may not be as high as they otherwiie would 

be all else constant, and turnover of staff may fall* In addition, 

a teaching program allows information to be gathered about particular 

potential job applicants ~ the students and residents themselves . 

The IMO will face less risk in making a job offer to a physician who 

has trained there , since the lU-iO has observed him or her in actioni 

7 

and the physician is better prepared for a future job at the HMO. 

Data required^ survey of all staffs Including those not 
directly Involved in teaching efforts^ surveying preferences for 
working In a teaching institution; survey of students and residents 
in training to assess whetlier the applicant pool has expanded ; 
baseline measures of recruiting expenditures and changes over time 
In these measures* 

It is recognized that the costs and benefits to members of 
changes in staff satisfaction, effort, and recruiting will be 
difficult to measure In nn individual; JIMO. The HMO decisionmaker 
oonslderii^g taking on an education program should at laast have 
Information about the direction of probable changes in staff satis- 
faction^ effort j and recruitment, and their Importance to HMO costs* 
Only then can hn determine whether net cost savings from this source 
make the costs of the education program worthwhile, given benefits* 

^ Recruiting benefit was a mnjor argument for hospital nursing 
Jtrnining progrnms, nnd studies have Hhown that hospttals with diploma 
sclioola weue nctiially nble to mnkc lower snlary offers due to this 
recruiting ndvautaBu, (This has chnnged over time due to shifts In 
nursing education ») 



If both HMOs and UMO medical education programs become more common, 
it may eventually be feasible to carry out a national cross-section 
study to determine whether HMOs with teaching programs actually 
experience reduced staff costs, reduced recruiting costs, and lower 
staff turnover. 

E. Changes In the value of care to members. ^ 

The discussion above has focused on the impact of teaching on 
the costs of providing health care services at an HMO. The net 
effect of teaching will be to raise or lower the average cost per 
member, and, If prices are set at average cost, the premium cost 
per member. Teaching activity may also change the value of the 
care as perceived by consumers, since care provided by a teaching 
institution may be se'en as a different product from care provided 
without teaching. If care with teaching is more valuable to members, 
they would be willing to accept a higher premium cost to support 
the teaching activity; if teaching reduces the amenities or con- 
venience of care, members will find their wellbeing reduced by the 
introduction of teaching, unless premtum costs can be lowered to 
compensate for this decrease in the value of care. The impact o£ 
teaching on member satisfaction will therefore be a key variable 
for a decisionmaker working to maKlmlae wellbeing of members. 

The direction and amount of change in value to members can be 
gauged by a number of means. The rate of membership growth may be 
observed before and after the introduction of teaching, with special 
attention to any changes In the, rate of exit from membership. These 



observatlouK Bhould nL loasu give nn indicaHon of wlicUliar conaumer 
wlllinonoss to pay for HMO covorago has rison or decreased after 
the Introduction of the program. Surveys of members can provide 
information about membar satisfaction with the programp questions 
asked about response to increases or decreases in premium prices 
due to a teaching program. The teaching program may be seen as 
decreasing the amenities of care by producing a "clinic" atmosphere, 
invasion of privacy, and/or longer waits for care. The program may 
Increase perceived quality If care connected with medical education 
is especially respected In the community* 

Data required 1 rates of membership Increase and dropout 
rates before and after the introduction of the teaching program; 
or interviews or surveys of members ^ Including both users of care 
and the general membership. 
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Resource Paper No, 15 
■ 

COST BENEFIT ANALYSIS 
A, Overview 

1 . Introduction 

Cost accounting is always an Issue in curriculum planning. However, as 
Group Health is principally a health care institution with its first respon- 
sibility to Its owner-members, any proposed activity which might have a dollar 
impact must be very carefully scrutinized. A cost study was therefore almost 
an absolute prerequisite to changes in or even continuance of an educational 
program which does not obviously directly benefit the Cooperative. 

An issue which is not purely "dollar" cost, but which also needed to be 
considered was that the consumers who might be less aware of obscure administra- 
tive costs would have direct, first hand knowledge of adverse effects of teach- 
ing. and the reallocation of patient care services. This 1s especially apparent 
in a clo'sed system where physicians who reduce their patient care effort in 
order- tdCiteacli reduce their availability to patients who have contracted for 
services. The pre-paid consumer will be served, and the result may be that 
the non- teaching physicians' patient, loads may increase as a direct consequence 
of this reduction by the teaching physician. When these hidden human costs 
are coupled with the inflationary pressures already present in health services, 
the suggestion of even continued teaching roles for the medical staff, v/ithout 
thorough considerations of dollar and subjective costs, is likely to be met with 
vigorous debate if not outright rejection by consumers and/or professionals. 

Assigning costs to specific teaching activities Is often Ignored, but 
the Group Health - School of Medicine project provided an important arena to confront 
.this issue. It offered both, the impetus and the setting in which to approach 
what in education is becoming the increasingly important economic dictum of 
maximizing benefits from a fixed resource. This translated into "How much can 
and should we teach at Group Health?" . 

2. Methods 

In this report cost is construed as any factor causing an increase in 
expense or effort, or a decrease in satisfaction. The approach used was that 
of management-based, cost-benefit analysis, 

Management analysis, as contrasted to strict accounting or theoretical 
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economic approaches, allows for a practical analysis considering both those 
costs and benefits readily quantifiable in dollar terms* as well as those 
costs and benefits which may be of great importance but which cannot be readily . 
assigned an unequivocal dollar cost. For example, the quantifiable costs and 
benefits liiulude labor, spacer materials and Income, The non-quantifiable costs 
and benefits include job'Satisfaction, enjoyment, effort, morale, and patient 
attitudes. 

The precise costs and benefits derived from this managment analysis of 
Group Health teaching are directly relevant only within the framework of the 
Cooperative, Costs and benefits from the standpoint of Group Health, the School 
of Medicine, governmental agencies or society at large, are not .precisely the 
same because of differences in the values and need dispositions of these dis- 
parate systems. However, for the purposes of this project and its sequels, 
the subjective costs might be given mutually agreed upon dollar values for 
negotiation within and between the managements of Group Health and the Univer- 
sity. 

An input/output model was created to document elements in the pre-paid^ 
group which impact upon or are impacted by the teaching process* These v/ere 
measured in three areas: 

-Actual teaching site 
-Direct support site 
-Group Health as a whole 

Under each arei the input such as labor, space, and effort, and the outputs 
such as education and enjoyment were listed (Appendix L, Table I)* Methods were 
developed to practically measure these either quantitatively or qualitatively. 
The term "practically'' is quite important, for there are some quantitative data 
obtainable only at a cost exceeding their value to the system* 

In translating the analysis into educational dollar cost, two problems 
arose/^^ One was the lack of a readily defined market value on many of the inputs 
and products of the educational process. The other was perhaps an even greater 
problem in that there was simultaneous production of more than one product 
(health care and future physican training) from the input system. The result 
of this latter factor, termed joint production in economic terms, is that there 
Is no unique cost ascribable to either product, Issues revolving around joint 
production have generated a geat deal of controversy in previous medical educa- 
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TABLE 1 



From Apperidlx L, Final Report, 
University of Washington 



ANALYSIS 



A. CostTBeneflt Analysis Related to Teaching in Group Haalth .Cooperative 
I, Teaching Site 

Persons Involved: preceptor, nurse* receptionist, studentt patient, 

non-teaching physicians 

Items considered (can be Increased or decreased by teaching) 



Space 
Time 
Effort 
Materials 



Income 
Education 
Enjoyment 
Care delivered' 

serst quality) 



IL Support Level 

Persons involved: preceptor, nurses, administrators, educational 

support staff 

Items involved 

Planning 
Administrative 

Orientation and indirect instruction 
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III. Group Health Cooperative as a " 

Personnel involved: employees, consumer-proprietors 

I 

Items involved * 

Factors relating to consumer 

membership cost 
* professional reputation 

queing 

net effect of teaching encounters on patient satisfaction 
community service Image 

Factors relating to staff 

rocruitmcnt 
staff turnover 
staff morale 



From Append Ik L, Fina l Repoif t p 
University of Washington 

Methodology . ; 

I. Interview partly structured 

Used to collect Initial Information* Used becuase of small numberSs 
personal contact afforded^ and relative flexabllity. Especially 
valuable where largely subjective determinations were Involved,/ 

II. Questionnaire 

For follow up information and where large numbers were involved, 

III. Clinic Records, Logs 

Used to provide Information on patients seen, cost per vislti hours 
on job, etc, 

IV* Personal Logs 

Used to provide additional Information on time spent and activities 
that appeared to have a major impact* 

V. Time-Motion 

Used to provide detail and to validate logs. 
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: tipn cost studies. . 

^ There are factors In pre-paid^ group practices which to some extent mlni- 
mize those problems. The primary product of a pre-paid health maintenance 
organization such as Group Health is health care service. Unlike schools of ^ 
medicine, reseaflh and teaching are, secondary activities at best. Also, due"to 
the size of Group Health, the number of different settings in which care is 
dellvered^and their thorough and ongoing accounting system, It is quite possible 
to look at the same or virtually equivalent patient care service setting In the 
presence and absence of teaching and evaluate changes in terms of amount and 
patterns of patient care services delivered. The cost to the Cooperative for 
teaching at a given site can thus be equated to the value of loss in services. 
This solution to the joint production problem assumes that patient care services 
are of highest value to the. system and that the value of a given unit of health 
care 'Is not altered as a function of the presence or absence of teaching. 

This form of analysis was applied to both the family practice residency 
program and to a series of undergraduate clerkships described previously in the 
curriculum section. In brief, these consisted of: 

a) Introduction to Clinical Medicine - Human Biology 413, 422 and 
435. 

A first year required course series conducted largely at. Group 
Health. 

b) Family Medicine Preceptorship— Family Medicine 401. 

An elective course primarily for first year students in which 
approximately one-fourth of the students are taught at Group 
Health clinics by their medical staff. 

c) Family Medicine Continuity Clerkship - Family Medicine 420, 

421 and 422. . . , ^ ^ 

A second year elective course series which includes Group 
Health preceptors among the faculty. 

d) Independent Field Study - Public Health and- Community Medicine 

531. ^ . 1 

An elective in which students Independently arrange for special 
projects at community health agencies - commonly Including 
Group Heal th. 

Since both first- and second-year Family Medicine clerkships were con- 
sidered, it was decided to include a third-year clerkship for the purposes of 
eontlhulty in the cost analysis which follows. 
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B, MEDICAL STUDENT COURSES 



1. Family Medicine Clerkships 

Because of their similarity, the three year family practice series has been 
considered together here. The first year Interviewing course and the health 
services research course are considered separately. 

At the cllnjical teaching site for the three course series^ patient care 
and education are produced jointly. Costs shown in Table V-1 were determined 
as follows: visits displaced by teaching were measured by comparing the 
patient visits per day under normal circumstances to the daily patient visit 
rate when the students were present. This data collection was accomplished 
by use of clinic logs. The number of visits displaced Is normalized to whole 
clinic days to facilitate comparison among courises taught for both full and 
partial days at the teaching site. Jhe derived displaced visits were multiplied 
by the unit labor cost to give the physician cost per student per day. Table 
V-1 shows that the major cost determinant was the joint cost of physician labor. 
Physicians are salaried and "full-time"^ but nurses contract for a standard 
week and teaching costs Incurred through nursing needed also to be addressed. 
In courses where the physician worked longer hours to produce their normal 
number of visits per day, the nurses also worked longer. A direct and readily 
quantitative cost occurred In some instances as nurses claimed overtime pay. 

Since a case can be made that use of visit count changes is an incomplete 
assessment of the Impact of students upon a health care del ivery setting, an 
extension of the clinic records study was begun to validate the data, pilot test 
a methodi and gather data regarding the student-preceptor interaction. This 
portion of the project involved a time/motion study tailored to the ambulatory clin 
setting and conducted in a third year elective course in Family Medicine taught 
at a Group Health satellite clinic (Appendix L), ' 

• Table V-2 contains the non-dollar costs and benefits of the three studied 
Family Medicine experiences reported by physician and nursing staff. No patient 
satisfaction data Is currently available due to delays in obtaining Group Health 
approval of the methodology and instruments to be used. This portion ,of the 
study will be completed at a later time. 
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TABLE V-I: CLINICAL TEACHING SITE - OBJECTIVE COSTS 



Joint Costs (visits displaced) 



>Labor 



Unit cost 



Physician $8.77 visit 

Nurse $2,31 visit 

Materials $ .33 visit 

(linen, injectables) 

»*Overhead $2.22 visit 

(bulldingp clinic, office, 
administration, general 
administration 



1st, yr. FM 



2nd yr. FM 



0 (0) $52.62 (6) 

0 (0) $13.86 (6) 

Not applicable 

0 $13.32 (6) 



3rd, yr. FM 

$35.08 (4) 
$ 9.24 (4) 



$ 8.88 (4) 



TOTAL JOINT COST 



$79.80 



$53.20 



Direct Costs 
*Labor 
Nurse 



cenais 
(books, tapes, etc.) 

Income 

Cost Savings 
TOTAL COST 



$4.50 

0 
0 
0 

$4.50 



0 
0 

0 



$79.80 



0 
0 

0 



$53.20 



All costs are dollars per whole student day, i.e ., one student day represents 
one student present for one full day or two students present for one half-day 
session, etc. , . . 

*labor - joint costs - visits per day displaced x unit cost 
♦♦overhead included since it would have to be redistribute'd to other visits if 
not accounted here - no overhead is directly assigned to teaching. 
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TADLE V-2 

CLINICAL TEACfllNG SITE - SUBJECTIVE ANALYSIS 



Time in minutes spent per day 
beyond normal working hours 
with no compensation. * 

Physician 

Nurse 



COSTS 

1st. Yr. FM 
Obs. 



30 
10 



2nd. Yr. FM 
Lim. Part. 



20 
0 



3rd. Yr. FM 
Part. 



45 
0 



Effort - Number reporting 

Increases/total involved. 

Physician 6/6 

Nurse 2/5 



3/3 
0/3 



3/3 
0/2 



c. 



ment - Number reporting de- 
creases/total involved. 

Nurse 



0/3 



0/2 



BENEFITS 



a. Enjoyment - 



Number reporting in- 
creased enjoyment/total 
involved in course. 



ERIC 



c. 



Physician 6/6 

Nurse 3/5 

Education - Number reporting In- 
creases/total involved. 

Physician 6/6 

Nurse 3/5 

Effort - Number reporting decreases/ 
total involved. 

Nurse 0/5 



3/3 
2/3 



3/3 
1/3 



2/3 



3/3 
1/2 



2/3 

1/2 



0/2 



* No increase In personal income was reported by either physicians or nurses, 
was usually reported as representing a reduction in personal time available. 



Time 




Support site analysis revealed no easily quantifiable costs, for at 
■the individual course level it is difficult to assign direct administrative 
costs (TableV-3) Four of the most directly Involved Group Health administra- 
tors estimated that very little time was spent considering any medical student 
teaching (rv 20 total hours). An additional cost source would be displaced 
patient care services as a function of scheduling educational planhing/admihl- 
stratlve meetings during office hours. It was not possible to make a definite 
determination of the magnitude of this cost source. 

As indicated earlier in this report, some objective aspects of the cost/ 
benefits to the Cooperative as a whole from teachino medical students could not 
readily be studied within the scope of this projec". Kowever,interv1ews with 
nurses, physicians and administrators did not reveal any area of notable increase 
or decrease in cost with respect to such areas as professidnal and non-pro- 
fessional labor, supply usage, space considerations and general overhead. 'Overall 
subjective costs and benefits to Group Health for this teaching effort are 
Included with others later in this report (page_86). However, current dollar 
costs for these courses are identified and summarized in Table V-3. 
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TABLI." v-;^ 
SUMMARY 

OBJECTIVE ANALYSIS - FAMILY MEDICINE COURSES 



1st. Yr. FM 

Obs. 



2nd. Yr. FM 
Lim. Part. 



3rd. Yr. FM 

Lim. Part,, 



I, Teaching Site per 
Student Day 



$ 4.50 



$ 79.80 



$ 53.40 



11. Support Level 



III. Group Health Cooperative 



Total Cost per Student 
per Day 

Number of Student Days 
7-1-74 6-30-75 



(1) 



1 



$ 4.50 
X 50 



$ 

$ 



0 

0 



$ 79.80 
X 59 



$ 
$ 



0 
0 



$ 53.20 
X 40 



Total Cost per Year 



$ 225.00 



$4708.00 



$2123.00 



Cost Savings 



Income 



Teaching Site 
Support Level 
Group Health Cooperative 

(2) 

Teaching Site 
Support Level 
Group Health Cooperative 



$ 

$ 

$ 



0 
0 

0 



0 
0 

0 



0 
0 
0 



$ 0 
$ 0 
$ 0 



$ 
$ 
$ 



0 
0 
0 



0 
0 
0 



(1) The number of total v/hole days of student instruction in each course at 
. Group Health Cooperative, (i.e., 50 student days = 50 students for one 

day, 5 students for 20 one-half days, etc.) 

(2) At present the University pays Group Health a sum of money each year for 
support of teaching programs as part of the affiliation agreement. Althoug 
this is accounted by Group Health as part of income for the residency pro- 
gram, the agreement provides for access to Group Health by University of 
Washington medical students. The student teaching Includes several courses 
not analyzed here so no apportioning of this Income has yet been made. 



2, Introduction to Clinical Medicine 

An impact review of the first year Interviewing course is found in 
Table Note that for some nurses there was a problem expressed, a reduction 

in enjoyment coupled with their increase in effort. This reduced level 
of nursing morale and job satisfaction could lead to reduced patient satisfaction 
as an Indirect result of teaching, even if direct effects of teaching do not. 
As was mentioned In the Human Biology 413 course description, nursing time 
was spent in making lists of available patients suitable for student interviews. 
In most cases this was accomplished^qulte easily. Yet at times when under- 
staffing occurred this minor task became a burden. Another problem, though 
the data is anecdotal and not formally summarized on Table was that there 
were times when patient treatment or housekeeping tasks were delayed when 
students were conducting patient interviews. These items may seem rather 
trivial from the overall perspective, but they constituted significant 
negative impact to the involved individuals. On the positive side. It should 
be pointed out that these problems were generally minimized by careful coor- 
dination by medical education specialists. 

Most of the dollar cost for teaching this course series 1s borne directly 
by the University in terms of salaries to two educational assistants respon- 
sible for coordinating interviewing space, students and patients. Without 
this "income", the educational objective costs at Group Health would increase 
considerably, and the course would presumably have a nch greater negative 
impact upon the^ satisfaction of the nurses, their support staff, and^directly 
or indirectly, on the patients. 

Physician time is also a hidden cost. Course descriptions note that one of 
twelve preceptors for the University-based portion was a Group Health physician. 
This preceptor's teaching and travel time came from personal time and time sched- 
uled for family medicine residency precepting. This latter cost is subsumed 
under residency costs and so represents no direct cost to Group Health, but it is i 
medical student teaching cost. The estimated loss of one hour of clinic time for 
each of the eighteen weeks is $475, With eight students present per session, 
the effective cost is $26,50 per student day for this ph:.sician*s^ time. This 
should legitimately be deducted from the residency prpgram cost and be added here. 
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TABLE V"4 
TRAINING COST SUMMARY 



Interviewing Course - HB 413-422-435 
Objective Costs to Group Health 
Source 

^ ,mm 

Physician 
Nurse * 
Educational 
Assistants 

Space ** • 
Materials 

Total per student day 
# of student days 
TOTAL COST 
Incume 

Cost savings 
Net cost 



Value - Reported in terms of 
*j dollars per student day 
unless otherwise noted. 

0.25 



4.90 

0 

0 



Subjecti ve Cost s to Group Health 
Classifi cation N 
Physician 1 



Effort 



Nurse 
Educators 



5 

2 



t 

i 



$5.15 
580 
$2900.00 
$2842.00 
0 

$ 58.00 



Enjoyment 

V 



f 



Time (Outside teaching 
site) 

30 min/session (Sstudent 
18 sessions) 



, Not appl icable 
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student - see evaluation section 

Patient » currently being assessed - delay due to generation and reviews 
of survey instruments by committees at Group Health Cooperative. 

Other hospital employees - not directly assessed 

*Nurse - Computed at $8,08/hr. Including wages and fringe benefits. 

**Space - One conference room was used 4 hours per day, 2-3 days/week. 

No other use was displaced or projected for the time occupied for 
teaching purposes, therefore no cost is imputed to teaching program, 

***Student days - computed by number of students inulti plied by the number of houi 

they were present divided by 8 hours. 
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3^ Public Health and Coimiunlty Medicine - Health Services 531 

This course Is an elective and the content for each Iteration may vary 
according to the specific Interests of the student and preceptor. At the 
time this course was reviewed for this project, only one student was both en- 
rolled and studying at Group Health, The involved preceptor reported that the 
normal parameters of cost we have considered in this phase of the study, e*g, 
professional and non^-professional time, space requirements, special or excess 
materials, additional overhead, etc, , were not Increased at all by the presence 
of a student. In other words, there was no excess direct or indirect dollar 
cost. 

Additional time was consumed by both the preceptor and the student as a 
function of the course experience, but it was time not directly related to the 
project nor to Group Health interests. For the preceptor this was estimated 
at thirty hours and for the student, eighty hours. It was. time spent in mutual 
discussions about health related affairs and In academic pursuits which origi- 
nated with the project, but which were not directly required for project 
completion. The expenditure was generally discretionary use of personal 
time, and hence is not charged to this course as a cost, nor is 1t credited 
as an objective benefit. 

On work directly related to* the special project addressed in the course 
content as developed for the student and the preceptor, the student invested 
approximately one hundred and fifteen hours 'in accomplishing the goals agreed 
upon for the project. A research assistant who otherwise would have to have 
been hired to accomplish the task for the Cooperative would be paid approxi- 
mately $6,50 per hour* Thfif afore, one could infer that Group Health realized 
a net benefit of $747 as a result of their cooperating with the University 
in the offering of the course. Additionally, the work was completed in a 
timely manner and the outcome satisfied Internal requirements of the organiza- 
tion. 

On the subjective level, the physician and student both reported having 
expended considerable effort on the special project. However, each also 
reported that the enjoyment, learning, and personal enrichment they re- 
ceived for their efforts far outweighed any personal cost. 

In spite of the glowing reports above, it should be stated that several 
special conditions were met in this particular educational encounter: 

-.The project was of direct interest and benefit to the Cooperative. 
O - The project was of personal Interest to both the preceptor and student. 

ERIC . 



- The preceptor invested his personal time in the completion of the task*. ^ 

- The student was academically advanced and had special competencies which 
qualified him for the particular, research topic, 

* The student was mature and had the ability to work within the Cooperative 
with a minimum of direct personal support. 

The outcome might have been less mutually satisfactory with a different student, 
preceptors or project. 

4. Subjective Impact of Courses on Group Health 

Subjective cost/benefits to the Cooperative as a whole need to be addressed. 
These have been estimated in most cases from interview data. Efforts to quantify 
their value are to continue. However, as mentioned earl ier, the effort required 
to quantify many of the subjective factors placed their measurement beyond the 
scope of this project. Despite this, it is felt that these qualitative issues will 
be given due weight in eventual negotiation between the University and Group Health 
over continuance or modification of medical student teaching programs. 

The subjective costs and benefit accruals were: 

-Community Service: The four administrators and two board members Interviewed felt^ 

that Group Health had an obligation to do its "fair share" of 
service to the community at large* However , though they 
agreed that medical student teaching was an important service 
which they should render to the community ^ they were unsure 
as to what portion of the service obligation should be allocated 
to this teaching. 

-Recruitment: Three of the four administrators saw benefits In: ^ 

-The eventual recruitment of the students exposed to Group Health 
into the service of this, or other, health maintenance organizatii 
-Enhanced recruiting potential of physicians in general because 
of the teaching opportunities within Group Health, and 
-Reduced cost of orientation for those physicians recruited 
who had previous exposure to health maintenance organizations 
in their resident or undergraduate curriculum* 
(Within the Cooperative, a feasibility study is being made to / 
assess the extent to which the above might be quantified and 
assigned a functional dollar value). 
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-Redi^^^d staf^ Turnover Rate: Interviewers felt enjoyment, self-esteemi and 

general morale were Increased as a function of teaching. Therefore, 
Job satisfaction is ihcreasedboth for nursing and physician staff. 
Introduction of teaqhing into a system would seem to increase 
overall satisfaction and to thereby reduce the turnover rate, 
Howeveri this benefit may be outweighed by decreases' in direct 
Patient services as a function of the teaching or the decreased 
job satisfaction of those nurses and physicians who increase 
their production to compensate* (A comprehensive study of this 
Phenomenon is planned by the University and the Cooperative)* 

Addlt-^ha] qu^stiQj^s raised by the study which need to be addressed are the extent 

to wfi'^^h ther^ 

-Enh^^^^ment ^he Group Health imaqe: Involvement with medical student teaching 
Could lead to a number of positive inferences by present and po- 
tential niembers. This might be reflected 1n Increases in membership 
application rates or to increased retention rates for current 
Cooperative members, 

-^Qual^'^^tive C^^e changes as a function of teachings The fluality of health care 
delivered may change either positively or negatively. To evaluate 
this element would require a major commitment to compare teaching 
Versus non-teaching physicians and/or sites on parameters such 
5s patient satisfaction* or the patient management processes and 
Outcomes. 

--Loss enrol^^^s^ Changes in withdrawal patterns may occur due to dissatisfaction 
With either being Subjected to direct teaching activities or to 
Increases in queuing due to losses In productivity Incurred due to 
the teaching program. Queues at present are four to five weeks - 
^ 500 visit per physician queue. Queue increase estimates based on 
the current program for Family Medicine and teaching are as foTlows: 



1st yr FM 2nd yr FM 3rd yr FM 
Obs. Lim Part. Lim Part . 

Estimated increase 
^n vf sits/year/ 
teaching physician 

current level. 0 120 40 



f^Umber of physicians 
noi^ involved 
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Finallyi it is the intention of project participants from both the University 



and the Cooperative that these issues be more thoroughly Investigated after. the 



termination of the contract. 
5. Summary 

This phase of the project produced three interrelated, yet disparate outcomes. 
Firstly* there was the generation and pilot testing of a method for applying 
cost analysis strategies from common business use to medical practice and edu- 
cational settings. This strategy included structured interviev^s of participants, 
observational schedules and logging participant's daily activities with and without 
presence of students. Secondly, there was the data generated from the cost/benefit 
analysis itself. And finally there was the conceptualization or insight which 
followed the presentation of the studies' outcome to those upon whom the Group 
Health medical student educational program Impacts, 

The model has been thoroughly presented In the earlier body of this section, 
and with certain caveatSsIt would appear that the business strategies used here, 
as well as others not used, could be used to analyse discrete cost to units of both^ 
health care delivery and health care education. The caveats are generally: 

-Quantity of care assessment here was tied to gross numbers of patient visits^ 
This was not deemed to be entirely satisfactory due to: a) the nature of the 
visits themselves was not homogeneous j and a larger sampling In more settings 
would be required to dilute the effect and to make the data more general liable 
and b) there were other benefits accrued to the Cooperative such as patient ai 
health care deliverer satisfaction and education which were not readily assigni 
a separate cost. 

-Quality of care may have been affected by the Introduction of students. 
Introduction of students may have led to more careful scrutiny of laboratory 
reports, a more thorough consideration of the presenting problems and resultlni 
differential diagnoses, and as cost-effective medicine v/as being taught for, tl 
cost-effective practice Ideal may have been more closely approximated with the 
presence of students. Alternatively, the very opposite effects may also have 
0 itrred. Though it is felt that student impact on patterns of health care 
del . ^ered should be dealt with^ they were neither studied nor assigned a 



occurred. Which outcome really should be assigned what portion of the "cost"-; 
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C, FAHILY PRACTICE HESIDEIICY TKAnilflS 

K Introduction 

Though the original project did not stipulate a cost/benefit analysis of 
Group Health's Family Practice residency program, such a study is included for two 
reasons* Medical student teaching at the Cooperative and their family practice 
residency were considered together in the memorandum of understanding betweeen the 
University of Washington and Group Health Cooperative of Puget Sound that formalized 
each institutions' roles and responsibility regarding these physician training 
programs at the Cooperative* Secondly, use of the analysis model with the residency 
program both demonstrate its applicability to a higher level of clinical teaching 
in the health maintenance organization setting and provides some valuable data for use 
by the responsible medical educators* 

As with medical student courses^ a managerial analysis approach was taken with 
the residency- This methodology is based in practicality* ThuSi in this study when- 
ever the magnitude of the cost or benefit exeeded the cost of its determination , 
an evaluation and translation into dollar amounts was made. Costs and benefits 
interpretable in terms of dollars have been labeled objective* Those not readily 
interpreted in terms of dollars either because of their small relative importance 
or large determination costs, have been termed subjective. This Is analogous 
to the medical student teaching portion of the study* The Initial step was the 
application of the cost/benefit model developed for the medical student cost 
benefit analysis with the major difference having been the greater number and 
variety of teaching sites within the Cooperative being studied so as to include spec- 
ialty rotations, coverage settings and classroom work as well as the family practice 
setting proper* 

2* Teaching Site 

a . Family Practice Setting 

The first setting considered was the Family Practice Unit. Geographically 
unified, this is a group of offices and examining rooms in which residents conduct 
a continuous family practice beginning with two half-day per week in their first 
year with eventual expansion to five half-days per week. Along with the residents, 
there are two family practice preceptors in the unit who manage their own practices 
on half-time and precept one-half time. Overall^ the residents spend approximately 
40% of their time In this setting* 

To objectively assess costs and benefits , one must look at the total cost of 
setting versus the total service output of the twelve residents and two preceptors 



in this setting* By comparing what it vvould have cost the Cooperative to produce M 
the same or equivalent services through Its usual system, one may discover the 
excess or marginal cost of maintaining the family practice residency program in 
the given setting. 

As with the medical student teaching phase of the cost/ber^fit analysis, the 
only practical way available to measure health care serivice provided is through 
the use of the patient visit unit. This use necessitated the assumption that 
residents engender the same number of visits for a given population as other Group 
^ Health family practitioners. This assumption was felt to be reasonable in view of 
the marked influence of the preceptors who are experienced and respected practitioner 
and in view of the common perception that third year residents are very like the 
other practitioners in every aspect of their practice. On the other hand, the 
assumption was only made in the absence of the preferable methodology, which 
would have been to identify the precise characteristic of the population served 
by the residency and to discover the cost of serving an equivalent population 
within other settings at Group Health. Such a methodology would measure, without 
the necessity for further effort, the frequency and cost of primary care visits, 
laboratory. X-ray, drugs, consultations, and clinical hospital facilities. As ^ 
was noted in the medical student analysis, this methodology was not deemed applicable 
since patient panels are not clearly defined, neither are they readily definable 
or manipulable for study purposes. 

Use of the patient visit methodology revealed an overall annual residency 
production of 21, 000 visits at a cost of $326,000, This represents a cost of 
$15,53 per visit versus the Cooperative's general experience of $13,92 per family 
practice visit. Thus the excess cost of resident produced services In the Family 
Practice Unit is $33,810 or, dividing by twelve for the number of residents, 
$2,818 per resident year. This excess cost or marginal cost and a breakdown of 
the cost per visit, is found in TableV-5/ 

The cost of Family Practice residency health care is only 12% in excess 
of the usual Group Health cost for the same services. Further, the excess is 
entirely accounted for by the Increased cost of nursing services per patient 
visit. Slight changes producing greater efficiency might allow the resdiency 
to break even in the Family Practice Unit, First year residents see an average 
of 13 patients per full office day, the second year 16, and the third year 19, 
and since there are only slight differences in salary year by year, it appears ^ 
that the older residents are, in a sense, "subsidizing" the younger residents. 
Therefore increased output in the earlier years would reduce cost as would 
gj^^" increasing efficiency of resident use of nursing staff. 
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b. Specialty Rot ation Setting 

^ The second major resident teaching setting Is the specialty rotation in 

which time is spent in limited participation in the daily practice of various 
specialists. Residents spend approximately 35% of their total time here. , The 
specialists have one resident in their practices from two weeks to four months 
out of the year. Whether or not specialists reduce their patient loads during 
this time is decided by the Individual specialist by agreement with associates. 
1n the same specialty, for a cut-back by a given specialist is reflected in the 
workload of fellow specialtists. The practice reduction decisions are variable- 
General Surgery does not; some subspecialties of Internal Medicine do, while 
others do not; Dermatology does, and Ophthalmology does not; Urology does, 
while ENT does not. Where cut-back are made, theyvary from 10 to 25% reductions. 

In contrast to the family practice setting, no staff are displaced by the 
Introduction of residents into the specialty rotation setting, nor is there a 
net increase in services attributable to the residents' efforts. Contrarily, 
there is a net cost in effort and personal time on the part of the teaching 
specialist and/or a loss In production of patient services. Where there Is no 
productivity loss (I.e., no-cut-back in patient load) there is a greater expen- 
diture through increased effort and reduced personal time . 

To discover objective costs and benefits In the Specialty Rotation Setting, 
one must measure the decrease In productivity accompanying teaching. Once again, 
the patient visit must be accepted as the best available productivity measure. 
At Group Health an estimate of productivity loss was made through Interviews 
of teaching physicians. Over the range of specialists, some of whom cut back 
and some of whom do not, the overall estimate of productivity loss is 10%. Were 
It not for the donation of personal time and effort on the part of those who 
do not use the cut-back in workload that is allowed them, the value would more 
likely approximate 20% productivity loss. The 20% figure was used in a previous 
presentation of this study's cost estimates, and whether to consider the personal 
time and effort involved in teaching as a dollar quantified opportunity cost 
to the Cooperative is a difficult decision. However, the reciprocal relationship 
between cut-back in patient load and personal time and effort involved in teaching 
is clear. In the present analysis, the 10% objective cost figure has been used 
and the associated increased cost in personal time and effort has been treated 
as a subjective cost. 

The 35% time spent by residents on specialty rotation annually is equivalent 
to 4.2 resident years. Thus 4.2 specialist years are subjected to the estimated 
productivity loss. If the cost of physician time with the attendant nursing 



services and overhead is estimated at $70,000 per physician year, this portion 
of the rosldency experience costs approximately 4.2 x 0.1 x $70,000 or S29, 400. 
In addition, there is the cost of the resident's time, calculated at 4.2 x $10,440, 
or $43,848 for a total of $73,248. 

c. The Coverage Setting 

The third major setting considered was that of Coverage, time during which 
the resident Is on call In the hospital in Internal medicine, obstetrics, pediatricsi 
or emergency departments. Residents spend approximately 25% of their time, or J 
three resident years per year, in these settings. Thus, the first cost 1s resident- 
time which may be calculated as 3 x $10,440 or $31 ,320. There Is no productivity. 
loss in this setting, for the residental presence has not resulted in an Increase 
In staff required for coverage purposes. On the other hand, there has been no 
evident increase in productivity attrtbutable to the presence of the residents, 
as there has been no decrease in staff required for coverage. Thus, it would 
seem to be Justified to interpret that there has been neither a cost in product1v1ty\ 
loss nor a benefit through increased productivity In this setting. 

Specialists in Internal Medicine, Pediatrics and Emergency Departments H 
perceived resident coverage/teaching as an oven trade-off through decreased % 
service time but increased teaching time. 

The Obstetrical coverage situation may have been an exeption which realized 
a net saving. Group Health presently experiences approximately eight births per 
day and during off-hours these are covered by an on-call obstetrician. The | 
notorious variability of workload in labor and delivery frequently requires the 
obstetrician-on-call to call in the second obstetrician on-call, or back-up obste- 
trician from home. Since the institution of residency coverage, rarely has this | 
been necessary. It may be estimated that this decrease in manpower requirement | 
represents one-quarter of one physician; however, this decrease has not been ^ 
directly translated into hiring or staffing policy changes. 

Without consideration of the rendered obstetrical , services, the total cost 
of the Coverage Setting is $31,320 in resident time or $2,610 per resident year. 
Most residencies do not include significantly long rotations in specialist offices. 
Traditional residencies in other than primary care are comprised almost entirely 
of Coverage Settings which Is presumably a much less costly mode, especially where 
the presence of a resident is not In addition to, but is in lieu of a staff ^ 
physician. Most primary care residencies teach specialty material in the Coverage * 
Setting, without teaching in the context of the daily practice of specialists. In 
view of the high cost of the Specialty Rotation as constituted in the Group Health S 
ERJC" ^00P^'*3tive Residency, the alternative offered by other residencies deserves 
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consideration as a cost reduction measure unless clear and valuable learning 
outcomes or other benefits are documented, 

dp Classroom and Off-Campus Settings 

The fourth setting of the residency is the non-clinical teaching which takes 
place outside of the clinical setting such as classroom instruction and teaching 
taking place off campus. The cost of on-campus overhead for this instruction 
has not been evaluated because it is small in comparison to other costs, and 
therefore has played a relatively small rolp in management decision making. 
Otherwise, the costs of classroom and off-campus teaching are summarized as 



follows: 

Consultant teaching fees $3*000 

Audiovisual equipment 1,000 

Travel and tuition for off- 
campus courses 5,000 

Total $9,000 

Cost per resident year $ 750 



3. The"Support System" Setting: Planning and Administration 

Planning and administration costs ZB% of a physici^n*s time ($10,000), 
75% of a medical educator' s time ($12,125), and 100% of a secretary ' s time 
^8,400), $1,350 in overhead, and $900 in equipment. The total of these is 
$32,775 per year, yielding an administrative cost of $2,731 per resident year, 

4, Total Ob.lective Costs of the Residency - Some Considerations 

The total of the above objective costs is $180,153. per year, yielding a 
cost per resident year of 15,013 (Table V-S), 

The importance of this total objective cost figure lies not in its absolute 
value but in its relative magnitude and in the relative contributions of the 
various settings to the total cost. It has been observed that the Specialty 
Rotation, which accounts for 35% of resident time, accounts for a disproportionate 
amount of the cost. By contrast with the Specialty Rotation Setting, there is 
the relatively low cost and high yield of training in the Family Practice Unit^ 
Thus, the simple expedient of substituting coverage situations for Specialty 
Rotations, as most residencies do, would reduce the total cost to i^i'uh I and 
the cost per resident year to $12,563. 

It can be seen how manipulation of settings may substantially cfto residency 
costs. Similar examples could be elaborated for the effect of various vuriables 
on cost,, including the level of attainment of the learner, educational objectives. 




"ce provided for education, and preceptor and preceptee roles; all of which 



Hi 

uUiniately be an arbitrary assignment of value by the aciniinlstratTon. 

The data revealed that the critical cost determinant was the preceptor's ^ 
perception of role. How much time was felt should be devoted to teaching students? 
Fromwhence should come the time devoted to teaching? Should it come from decreases 
in volume of delivered patient care or from reallocations of personal time? Costs 
such as supplies, nurses' time, laboratory requests and space were trivial in 
comparison to the cost of the preceptor's time. However, the issue of space for 
medical student teaching was felt to be a potentially significant cosfsource, 
though it was not so here due to the available facilities. Ultimate dollar costs 
ascribed were $79.80 per student day for second year interviewing and physical 
examination training and $53.20 per student day for third year Interviewing, advanced 
diagnostic examination and initial patient management training under the current 
curriculum. 

From this portion of the study a major outcome was the recognition by faculty 
and administrators at both institutions, as well as recognition by involved con- 
sumers at Group Health, of certain cost and benefit factors involved with medical 
student teaching at the Cooperative. These groups also came to realize that the 
factors were to varying degrees both quantifiable and controllable. Among the 
factors and constructs now appreciated by these groups are: % 

-Most cost/benefit apportionments are often difficult at best, and medical 
education in a health care delivery setting is Joint production, which raakes 
valid cost apportionment even more of a problem. However, there are analytical 
methods which can be used to assign to educational activities reasonable 
values which can then be used for planning purposes by the University and 
Group Health. 

-A major factor influencing the preceptor's time consumption in given educational 
activities is role perception. One can clarify and monitor role expectations \ 
and thereby gain a measure of control over time spent for educational purposes.! 

-Through use of the strategy of patient visit monitoring, It may be possible to 
monitor dollar equivalent costs. Where fluctuations are noted concomitant 
to the students' appearance in clinics for teaching purposes, cost allocation 
with compensation can be made. 

-There are subjective costs and benefits such as enhancement in patient and staff 
satisfaction with Group Health, prestige associated with being a medical edu- M 
cation institution, or decreases in morale due to increase in effort or dis- 
ruption of systems. These can be studied and assigned values which may be 
useful to managers. 

In cum fhie ni^w^i'^^ ^£ iu . .i. .1 



TABLE V- 5 
Cost Per Family Practice Visit 



Overall Residency Cost $326,000 r„,.,,„,^ 



""'"^"^^ .Overall HMO 

Labor 



Physician 7.45 
Nurse 5,72 
E>^Penses ,36 

QmhsM 2.00 (estimated) 

15.53 ^3 gg 

Expenses exclude lab. X-ray, prescr1pt1ons=these are treated as fixed costs for 



8.77 
2.31 
.33 
2.51 



the HMO 



TABLE V-6 



Residency Program 



Residency - Objective Costs 
Teachlnq Site 



Family Practice Setting - 



Speciality Setting 



Coverage Setting 
Classroom setting 



Actual cost 
per visit 
(teaching) 

Equivalent 
cost per non- 
teaching 

Net Cost/visit 
Number of visits/ 
year 

Net Cost/Year 
Number of re- 
sidents 

Net cost/yr/re- 
si dent 



Labor plus 
Overhead 

Resident's Labor 
Total 

Resident Labor 

Consultation 

Audiovisual 
Travel 

Total 



Total 



15,53 



13.92 

1,61 

21,000 
33.810 

12 



29,400 
43,848 

73,248 
31,320 

3,000 
1,000 
5,000 
9,000 



Per Resident 



2,818 



6,104 
2,610 



Support System 



HMO as a Whole 



Labor 



32,775 
0 



2,731 
0 



180,153 15,013 

(Cost Beyond Service Produced) 
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are controllable by the program administration. 

5' Subjective Costs and Benefits- A M a n agement Concept 

As mentioned in the introduction, there are costs and benefits which 
are neither easily measured, nor readily cast into dollar values. Such var= 
iablesinclude education of medical staff which may diffuse from a residency 
program, increases or decreases in staff morale associated with the ^)resence 
of an educational program, or increases or decreases in consumer demand for 
membership in the Cooperative contingent upon the public's perception of the 
educational program's value. Traditional economic analysis would demand the 
quantification of such variables in dollars. Even the most cursory glance 
at some of these variables, such as morale, staff and membership recruitment, 
and education, leads to the inference that cost of objoctifyihn measures of these 
variables could be some multiple of the annual budget for the residency itself- 
and the resultant dollar imputations might remain subject to accusations of 
arbitrariness. Nevertheless, in the absence of such objective measures, Group 
Health is faced with management decisions regarding its educational program. 

Thus, estimates here are based on the common managment technique of listing 
and subjectively evaluating the Intangible costs and benefits. While the 
Group Health administrator employing such a technique may not be able to ascribe 
a rigorous dollar value to changes in consumer demand secondary to the presence 
of tbe educational program, from a practical standpoint, he may discover all that 
Is necessary for the decislon-making process. Being confident that the rela- 
tively miniscule size of the teaching program has afforded no appreciable Impact 
on the overall Group Health subscription or attrition rate, and that those con- 
sumers directly involve^ in the teaching program are usually satisfied at or 
above the level of uninvolved consumersmay be sufficient. Such costs, or benefit 
may not be labeled objective as they cannot be readily converted into dollars, 
or will not be converted because costs of rigorous measurement and conversion 
cannot be justified by the benefit of having the information. Even so, it may 
be a very real cost or benefit of which management must have some reasonable 
estimate as the basis for reasonable decision making. 

In pursuing these managment objectives, the list of variables outlined In 
Appendix L, Table 1 has been assembled. Each represents a potential cost or bene- 
fit, depending on the dirction of change. Often a given variable may have been 
examined with respect to both Group Health employees and members. Discussion 
of these variables from a managerial point of view follows 
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6- ,Suminary of Subjective Costs 
Effort and Enjoyment 

Effort may be divided into the devotion of personal time and the sub- 
jective sense of effort during the working day. Interviews with the medical staff 
reveal that for preceptors there is increased effort associated with teaching 
while carrying a full clinical load without the benefit of cut-backs. For 
some preceptors, the reported concomitant increase in enjoyment is so great 
as to subjectively balance or outweigh the increase in effort. However, even 
in such cases, it is perceived that the increased effort could not be sustained 
throughout the year without a substantial negative effect. For medical staff 
members whose increased effort is not offset by increased enjoyment the "cost" 
is evident and may be critical. The dollar values which might be attached to 
this effort change are subject to negotiation and have not been quantified^ 
Further, as certain portions of the cost in effort may be offset by a benefit 
in morale, effort alone cannot be a sufficient base from which to make de- 
cisions regarding an educational program. It is also clear that it would be 
unwise to choose preceptors whose personal effort Is^not perceived as being 
somewhat balanced by the increased enjoyment they associated with teaching* 

Nursing staff employees reported no marked changes In effort as a function of 
the residency teaching situation. However^ some have reported a benefit of 
Increased enjoyment associated with professional education. 

In Coverage situations^ with the exception of Obstetrics which has been 
discussed above, the interview results Indicate an approximate balance between the 
increased effort of teaching and decreased effort expended In service* There 
was also increased enjoyment for about half the surveyed staff associated with 
teaching. Internists Indicated that should such resident coverage be ex- 
panded, the balance would shift toward a net benefit resulting from a decreased 
service effort* It 1s obvious that for a systematic effort reduction to occur 
to the extent that it affords an objective benefit (as obstetrical coverage does), 
the coverage delivered by residents must be pervasive and consistent. Nursing 
staff reported no significant changes In effort or enjoyment in coveraoe situation 
with the exceptions of the Emergency Department, where workinn with residents 
was sometimes perceived as requiring increased effort due to slower work rates and 
variations in levels of ability; and ward coverage, where ,the availability of an 
on-call resident when ward problems arose was perceived as decreasing nursing 
stress. 
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The consumers' sense of effort and enjoyment seems adequately balanced, 
'Effort, in the sense of personal time expended, is often increased in all three 
clinical settings - Family Practice, Specialty Rotation, and Coverage, But it is 
either perceived as a negligible cost or it is associated with appreciation and/ 
Or enjoyment of the attention. Rejection of the attentions of the resident has 
been an infrequent problem which is easily handled in its rare occurence, 

b , Consumer-Related Factors 

The effect of the residency on demand for membership is considered trivial. 
Indeed, the presence of the relatively small residency is not widely known to 
the public* Consumer satisfaction with residency-related services is felt by 
the staff to be at or above the average level so that a negative impact on demand 
would not be expected unless the residency format were drastically changed. 

Dissatisfaction with house staff-provided services in other programs is 
often associated with settings in which the house staff is preponderant and is 
not adequately "leavened" by experienced staff. This is clearly not the case 
at Group Health. 

c. Health Care Delivered 

The staff did not feel the availabilityf accessibil ity , and acceptability 
of the health care delivery were significantly affected by the residency program. 
Occasionally the long hair or casual dress of a resident was mentioned regarding 
acceptability I but a significant rejection by consumers has not been noted, Alsc 
mentioned was the fact that residents build their practices partly of difficult 
patients and patients uncommitted to any one physlcian-this may be interpreted 
as an Increase in availability and accessibility, but In any case, is expressly 
appreciated by the more senior medical staff. 

Adequate outcome measures of effectiveness have not been devised for 
Group Health as a whole, much less for the residency alone, Regardina quality 
as measured by process, it is the general opinion of the staff that sub-standard 
care has been eliminated in the Family Practice Unit, Some staff report that 1n 
preceptor situations they are more careful to insure that process adheres to 
formal ciriteria, and this behavior may lead to an Increased quality of care, 

Recruitment 

It is generally believed that the residency has a moderate positive effect 
on recruiting but not enough to induce any great stress were the residency to 
be eliminated. Recruitment is affected in a number of ways. Approximately half 
the residency graduates themselves are recruited onto the Group Health staff* 
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In addition, each ycnr two hundred applicants for four rnsidRncy positions are 
exposed !.o the Cooperative. There may be some increased recruitment and/or 
decreased turn-over associated with recruits who prefer an Institution 
committed to teaching. Finally, the presence of the residency itself may 
induce modifications in the style of GroupHealth practice designed to make 
it more attractive to current residsnts which also makes it more attractive 
to residency graduates, 

e , Morale^ 

The general morale of the staff seems mildly increased by the. presence 
of the residency. There are exceptions, but those who express displeasure 
are only mildly affected and are not those directly associated with the residency. 
Morale of those teaching seems moderately Increased, which 1s to be expected 
since they have chosen to teach. 

Morale Is a complex function, dependent upon effort, enjoyment, education, 
a perceived need to teach, and a perception of Increased institutional or 
individual prestige derived from teaching. These ramifications of relationships 
will not be elaborated. Morale Is most positively affected where coverage 
situations are associated with a large decrease In effort expended In service. 
As discussed above, such a situation obtains in Obstetrics, and, potentially, 
in Internal Medicine and other direct coverage settings. 

f. Continuing Education 

The continuing education of the medical staff, especially the Family Practice 
Staff, IS considered to be moderately augmented by the presence of the residency. 
Residents conduct one-third of the family practice educational conferences. Further 
there Is the difficult-to-measure, but important diffusion of learning by random 
contact by staff with the residents or their preceptors to bring new ideas, infor- 
mation, approaches and challenges to the staff. This diffusion Is maximized 
in coverage situations, although unfortunately there is no coverage situation which 
zonsistently exposes the residents to the. full family practice staff. There is 
also the stimulation of preceptors to Independently further their own education 
through extra reading or participation in more formal learning experiences, v/hich 
effect is perceived to be moderately positive. It has also been noted that some 
nurses in preceptor situations appreciate a moderate educational benefit. 
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7, Overan O utcome 

The overall outcome of the residency cost study was parallel to that of 
the medical student course cost study. Methodologies were developed and piloted 
which generated cost data regarding the training of residents 1n a health main- 
tenance organization* Further, where it was demonstrated that certain parameter 
could be readily quantified, there were others for which the cost of objectifyin 
would have exceeded the potential value of information obtained. Even for these 
however, subjective evaluations of relative cost , benefit and Impact could be 
made wh!ch could be of use to decision makers within the University and the 
Cooperative, 
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Resource Paper No, 16 



MEASURING THE COST OF PRIMARY CARE RESIDENCY TRAINING * 



* From Part III of the Harvard University Final Report, December 1975, 
Project to Develop Curriculum for Physician Training in IMOs* 
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MEASURING THE COSTS OF PRIMARY CARE RESIDENCY TRAINING 



United tatar^'h.vi 1 hospitals, like teaching hospitals throughout the 

service needs 'o? th/ln"t'? ^-^loped residency programs in response to the 
of specialty board^ Thf^ ""f conformity with accreditation requirements 

director^ tn J^^e response to service needs has permitted program 

rP^iS^n^f . \ '^7"'^ °^ residencies to the hospital. ITius, 

recen?Jv J?nf^"?'' """^^ ^'""'^^'^ ^"""^^y* ^^^1*^ insuranci and more ' 

SnSital^ In t^'.'"'"'''"f ' J'"^ P''^ °' operating costs of 

.1^ „ P-,"^' " ^his capacity the direct costs are Included In the day rate 

thS diiLrcost' r^^'r^' y''''^' housekeeping, and so on. T^e amount 
pressures ?o 1^ deteCTiined by the laws of supply and demand with 

fhnn^inf^ 1 ncrease Wages coming from house officer associations, comparison 
applicants^'tn^ ^"^"^^"^ of losing qualified 

has come Dredom'i^ ^T^T"* ^^"T^ programs. Negative pressure outage levels 
rerr.M?f ao H K r^- -^^"^ ^^"^^^ °f prestigious training programs to 

amons other tpa^V "^-"""1 f f '^""S low wages, and from peer'pressSe 
costf of inoHtlent"? °" escalating wages."^ The indirect 

rounds nnddfi^^r training m the form of faculty time required for teaching 
anreoine tJron^r^i'^''i''"f ^^"'^"istrat ive costs for Interviewing applicants 
x-ravs and fnn.? selection process, unnecessary laboratory tests and 
i Lfpartlaflv nnn f"^f "'^^^ difficult to measure. These coats 

the tlanh?nrf°^"'^;>;' °- ^''^^''^ '^^^ training programs has shifted part of 
of thP ^ I""™ ^ - inpatient service with Its economic buffering capacity 
of the day rate and research grants to the ambulatory setting with its more 
stringent requirements for economic accountability. In fee-for-service ambulatory 

partvlavorf "'f ^"^^ behind those negotiated ^Jth ?hird 

party payors lor hospital-based care, and few research grant-funded facultv 
have been eager to teach ambulatory medicine - to say nothing about the^r 
appropriateness had they bean willing. This contrast 1^ the'ffnancing ol 

of^Slenf ^ow*"'ti '^-^^^ '"*""S8 is further heightened by the 'nature 
ot patient flow. The inpatient occupancy rate - and thus, reimbursement rate - 
18 scarcely influenced by the time devoted to teaching. Is notenbove t?= 
influence is in the direction of prolonging hospital Iky LfSLe increasing 
occupancy rate. This added cost is then borne by society af large burmav ^ 

Jn tinmb'LJ"^"^^.^'"'"'^'"^''" P-"^- f inaSlaf beSf It. 

c^^^' ambulatory setting, a patient not seen because of a teaching 

conference or preceptorial discussion Is a patient fee lost to the practice 
whl^h^rff thl^ loss is expressed as a decrease In sta^^r^uctivity 

which would require a larger staff to provide the same benefit package to the 

Ichoof w^'b ' ^"^^i-l™ prodact at Harvfrd^Ilcal 

S r.S^r^''-^/'' ""^^^"^^ of residency training in the 

™LSy Cafe^Progra,!!^''''^' Community Health Plan (HCHP) and the mrvard 

r 
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The HCHP Is a pre-pafd group practice with a memberihip of SO^OOO enrolled 
in two centers. The Kenmore Center serves aSjOOO members in Boston and is 
affiliated with the Iteth Israel and Peter Bent Brigham Hospitals^ the Children's 
Hospital Medical Center, and the Boston Hospital for Women' The Cambridge 
Center opened in 1973 after receiving a grant from the Robert Wood Johnson 
Foundation which was given in part to create a site for the training of prirrHry 
care physicians. The Crimbridge Center is affiliated with the Cambridge Hospital 
and currently serves 15,000 members with a prodected goal of 35^000 members 
in full enrollment. 

The Harvard PriMjary C<ire Program began in 1973 with a group of six 
internal medicine residents at the htassachusetts Ceneral Hospital (2)5 the 
Iteth Israel Hospital (2) and the Peter Bent Hrigham Hospital (2), The program 
was expanded to eleven residency positions in 1974 with the help of a grant 
from the Robert Wood .lohnson foundation and matching Innds from Harvard Medical 
School, in July 1975, the adult primary care residency further expanded to 
include the Mount Auburn Hospital and Cambridge Hospitals and the Cambridge 
Center of the HCHP, with a total of 23 residency positions in all sites, 
A track in primary care pediatrics was initiated at Children- s Hospital Medical 
Center and nurse-practitioner training has been Integrated with the adult 
primary care residency at the Massachusetts General Hospital. IXindlng for 
tlie program is guaranteed only through June 1977* Thus^ from the very 
beginning we have been aware of the need to document the costs of training 
residents In aml>ulatory settings in order to make appropriate cost-saving 
modifications In the program which would have minimal impact on the educational 
content of the curriculum and to be more persuasive in negotiating reimbursement 
rates with third party payors and continuing support frari medical school 
funds and foundation grants. Ln a larger sense, we hope that our efforts 
and those of other groups examining the costs of primary care training will 
infl-uence the federal manpower legislation In a realistic and positive way, 

Itom the outset it was obvious that certain costs and benefits of the 
residency program would be difficult to measure and others would be unfeasible 
or impossible without resorting to elaborate accounting systemSj some of which 
immediately raised the question^ ^^is the Juice worth the squeeze?^^ The 
Impact of the residency program on marketing the HMO Is one such example^ 
For some prospective members the presence of a resident might be..a deterrent 
because the prospective members expects to receive care from a lially-trained 
professional in return for paying the premium* Or the residency program might 
be perceived as linking the HMO with all of the negative features of the 
teaching hoBpital OPD, On tlie other hand, some people %TOild be attracted to 
an HMO with residents in training because of the desire to have a personal 
physician who is also a teaclier. This view has in fact been expressed by 
several members of HCliP, As important as these costs might be to the HMO, 
we are not attempting to measure them at this time. 

We are focusing on the costs related to physician productivity in the 
HMO, Data is collected for management purposes on all visits to the Ifenmore 
and Cambridge Centers of HCHP, these encounters are recorded as number of 
single visits (15 minutes), complete check-ups (30 minutes) and long returns 
(30 minutes) on a monthly basis, 'Hie total nmber of encounters are then 
converted to the number of 15 minute equivalents in order to calculate the ( 
average number of equivalent visits each provider had per session. The 
ftill-'time physicians have eight sessions of four hours each per week at the 
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I ^rijT^^^ Sri^f nine .aaslono of three 

the Cambridge physicta^ nr^ri,!.?/ J comparable rates, 

equivalent 'iM^nnJ^^t^r^' calculated on the basl. of adjustad 
the nurse practitioners aJd Drim«^ ""5^" calculations are made for 

IS minute Slots were Allied hfJS^ residents at each site. If all 

«a the equivalent of W^ftSnrvisff^'"'"""- P^Vslcian should 

Program reimburses HGflP f^f fS/pf f , ^^^^ ^^^^^ard Primary Care 

time equivalent resident The 30 1 Lf 5 P^y""an's salary for each ftai= 

for precepting the resJjent ^Lwl^fequlvalen? ^ff f ^''t ^° ^^"'^ 
reducing the staff physician'^ nSJ f °^ visits per session, 

Several factors make this dycftr«n!rj*^ *° ' ^'""^ ^^^^ ^^^sion. 
care curriculum includes a Sies of I^lf?" erroneous. Rrst, the primary 
topics In ambulatory medlclnf Lparatinn'? "'^"""S important 

varying amounts of time denendinf^^ °^ ^^^^^^ sessions consumes 

with the topic, his orhe^SerLrin ^1,'""^"°'°" femillarlty 
the presentation. Secondly onlv fnn^ t '"^"^^'^ f<^""at of 

time Is devoted to internal'meSiJlne Thf '1°^ ^'"^ °^ resident's 
(five at Cambridge) are soenrin dp°; f ^^'^^r four sessions at Ifenmore 
^thopedics, ENlf ipShaSoJogy" t^^^^°"^' gynecology, minor 
the resident works with leas fnd^n^L^^ S^' ^" ""-^^^ °^ ^^ase areas, 
rewer patients who Se n^falso S brthr'? I"? "^""^ '"^^^""^ 
to the system is shifted towtrd thf ^ ! physician. 'iTius. the cost 

the preceptor spends more supfrvJsLr?;;"?^^ disciplines where 

resident "produces" fewer net oaiiP^r ^"1 ""^ ^'^^ resident and the 

latter area where we are e^DerienJln! ^^^^ is in this 

, the Impact which the resided iarx^>^ greatest difficulty in quantifying 
• can see per session! °" the number of patients which the specialist 

" CenterT^S^verSfst^S^^^ ^^'S at the Kenmore 

with a range of 9.8 to 17 3 Th"\ ^^'^ equivalent visits per session 

6 session, during the mon^h; aS if Selv'tS'bf ^^'f'/^ "^^^^^^ 

to see some of his returns befnrP i ^ that ha "ovei^booked" in order 

worked an average of l"!? selsSns lur nf thi«'vf internists 
care residents each worked an average J " vacation month. Six primary 
with a 7.1 equivalent visit per sSLn nf^ ^"""^ this same period 

residents who had spent six months nr ^l.^ -''''^' " the three senior 
now returning for the^^ sesiJon ner wif ^'^^ " ^^^^^ and were 

we find that they had an average of 8 3 "^^^^ analyzed separately, 

three Junior residents, at S'f^ Jheir'Srst'Jot^^'"' "^^S""' 

lur ineir tirst rotation, averaged 6.3 visits. 

an average of ^5.2 eeesiona had arave?fL°^/S^°"=' . SlK Internists working 
session. n,e four adult nurse Drac?<M™ equivalent visits per 

seeing 8.1 equivalent patL"Srv?aS% ::is?„°j'"'part':f ?f f 

between average number of sessions wo^w k °^ the discrepancy 

^ith the mtelnlsts at the SiLe S^t ""^'^ practitioners ^omparec 

^hat three of the four nursefS'LlI «L%' f "J"^ ^^t"^ 

?lth administrative responsiblllJVpi combined clinical 

ichedule seven or mojrfiinlcaf L.^.'n "'^ ^'f'^ °^ the six Internists 

:lme is devoted to aJ^lSSatlon h^soltfl^f'S* ^^^^'"""der of their 

. ration, hospital-based practice or home responBlbllltiea 
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When analysed soparnlely, the liill-lime physicians averaged 12*8 equivalent 
visits per session and t\m part-time physicians averaged 13.6 visits. 
One might argue on 1 he buBls of these findings that productivity increases 
as number of sessions per week decreases. If this observation were to hold 
up over time and with larger nimibers of pliyslGians involved^ one might then 
argue that decreasing a staff internists* number of sessions to create time 
for teaching might actually Increase unit productivity for the remaining 
sessions- 

If vie assume tluit all otlier factors at the two centers have equal impact 
on physician productivity, the presence of residents at tenmore can be said 
to have lowered the per session equivalent visits frwii 13*0 to 12.5, There 
were 258 staff sessions at Kenmore during this period which translates to a 
loss of 129 equivalent visits for the montlu Against this cost must be 
balanced the equivalent visits provided by the residents. During their 
36 sessions at 7,1 visits per session^ the residents provided care for 25G 
equivalent visits for a net gain of 127 visits for the month. If we further 
assume tliat a full-time resident witli ibur interrital medicine sessions per 
week averViging 16 sessions per month^j til 7.1 visits per session^ will 
generate 114 visits per months this can be compared with the staff internists 
productivity. Tlie fiill-time internists working 32 sessions per month at 
12.5 visils per session will provide 400 equivalent visits* As pointed out 
earlier, ttie remainder of the resident's week is devoted to more purely 
educational activities so far as llCIfP is concemedj and the resident-e con- 
tribution in terms of added patients cared for is minimized if present at all, 
llierefore, we can use the equivalent visits In adult medicine alone to compare 
productivity with a fully trained internist. 

The 114 resident visits are 28.5"*! of the staff physician encounters. 
If we include the 0,5 equivalent visits per session difference between the 
center with (Kenmore) and the center without residents ( Cambridge) p the 
resident's net productivity decreases to 27,4% of a staff internist. In 
our budget calculations for this fiscal yearj the average staff salary was 
$36^000 and the average resident stipend $12,0005 with fringe benefit costs 
being slightly greater for the staff physician, Itased on these salary figurr" 
alone, tlie resident would have to produce 33 1/3% as many encounters to equal 
the staff physician -s output on a cost-^equlvalent basis. The 5,9% short-- fall 
(33.3^1 - 27.4%') would then be the net cost to llCItP of the training program, 
ibr each ftill-tlme equivalent resident tliis amounts to a net cost of $2124 
plus fringe l)enei'its per year* 

Having said all of 1 his^, what is wrong with out method of calculating 
costs? firsts assuinlng that the above data are rellablejWe have not included 
the cost of space. In order for HCHP to deliver equivalent services to its 
enrollees^ two residents are required to replace each staff physician (7.1 
eqiiivalent visits per resident session is 57% of the 12,5 visits per internist)* 
ITiis figure^ rather than the 28,5% value, is used for space costs because we 
are here concerned only with the Internal medicine space needs. Stated in 
cost teCTiSj each resident requires twice as much space as a staff phyBiclan, 
With the decreased productivity per unit space^ the total enrolljnent in a 
facility using residents will liave to be curtailed. During the start-up 
period in the Cambridge Center^ ample space is available because the member^ 
ship of IS5OOO is cared for in a facility designed for 355OOO, The space cost 
now Is nullified by the benefit to IICUP of having additional staff to increase 
the capacity to keep a physician ^ nurse practitioner - resident team open to 
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new members. This ability to avoid closing a team to new members ii mainly 
thought to be a marketing assets and as such is very difficult to quantify* 

Administrative coats are comparable to space costs. For each new or 
additional person required to deliver the benefit package tc subscribers 5 
there are additional admlnlBtrative costSj i,e* processing the forms for 
salary, fringe benefit and tax purposes 5 orienting new employees to the 
center 5 planning appointment schedules, making space asslgrments. A major 
administrative cost for HCHP during the past year or two has been the staff 
time required for planning the residency iteeif and in discussing the method 
of presenting the program to membership followed by the actual presentation, 

A potential cost of the residency is the possibility of a higher rate 
of hospitalizations, more frequent return visits 5 and more frequent use of 
laboratory and x^ray examinations among patients seen by residents. We have 
no data yet to shed light on this question. Several confounding variables 
make It unlikely that we will ever have accurate data in these areas. First , 
the preceptor la actively involved in such major decisions as when to 
hospitalize a patient, what laboratory studies are most appropriate, what 
consultations should be requested, and how soon should the patient return* 
But as anyone familiar with the decision-making process on in-patient teaching 
services can attest, learning clinical management occurs in direct relation- 
ship with the amount of responsibility allowed. The second variable is the 
conscious pre-selectlon of difficult clinical problems for the resident to 
follow. In order to fulfill the objectives of the primaxy care curriculum^ 
this referring of complicated patients to the resident's panel will continue* 

Some of the benefits for HCHP of having primary care residents in 
training have already been mentioned. An important one is the increased 
ability of the Plan to attract staff physiclana because of the opportunities 
to teach. At the present time of steady growth in Plan memberships a slg-- 
nlf leant amount of administrative and professional time is devoted to 
recruiting new physicians. The historical precedent of Group Health of Puget 
Sound has not been lost on HCW, which views the preparation of future staff 
physicians as an Important result of the residency program. Anything which 
serves to limit the amount of time spent in recrul^ent activities by the 
highest-pail physicians In the HMO is a ve^ real finaTtcial gain for the 
practice. Hiring a physician who has been a resident in the practice also 
tends to minimise the risk involved whenever new employees are brought into 
the group. Again, however, all of these factors theraseives involve multiple 
.variables, and it is doubtful that any reliable value can be affixed to these 
personn^'^"', costs and benefits* 

Finally^ there is the benefit to society at large in having physicians 
trained to provide primary care services. If this benefit is perceived as a 
Justification for public support of primary care residency programs, the 1^0 
may benefit directly by receiving public funds for educational pu^osea* 
Hero is a]^eady receiving generous private support from the Robert Wood 
Johnson Foundation because of the view that aoclefcy will beneWt from the 
special training of physicians for primary care ftinctlons* 

In summary, we have outlined an approach to measi^ing costs Involved 
in training primary care residents in a health maintenance organization. 
Among the many different costs and benefits which have impact on primary 
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care residency Iralningppliysician productivity emerges as the central factor* 
It 18 also the , easiest factor to measure quantitatively. Rrelimirary resultB 
Irom the ^ttrvard IMmary Care Program and the Harvard GOTmunlty Health HLan 
BUggest that residentB^at the end of their second year of trainings who devote 
oriy half of their time in the HMO to internal medicine patients^ are capable' ' 
of seeing 7*1 equivalent visits compared with 12,5 for the staff interni it* 
When factors of different sala^ levels between resident and staff physician^ 
and the need for the resident to rotate tteough other specialties to acquire 
primary care skills are factored in, the cost to the HMO of training the 
primary care resident is approximately $2000 per year* As we gather additional 
datas the validity of this figure will be tested. 
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